00000001:02000400:2.0F:1789185404.987371:0:3290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789185424.586329:0:3513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789185426.150385:0:3575:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 679 MB/s 00000001:01000000:3.0:1789185426.400941:0:3575:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 601 MB/s 00000001:01000000:3.0:1789185426.651119:0:3575:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3139 MB/s 00000020:02000000:1.0F:1789185427.311106:0:3604:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_g357d090 00000400:02000000:1.0:1789185427.970312:0:3619:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.148@tcp [8/256/0/180] 00008000:02000000:2.0:1789185431.790671:0:3769:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789185501.991811:0:5739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789185515.659540:0:6488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789185515.659547:0:6488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789185515.659548:0:6488:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789185515.659655:0:6488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000028b2af8d 00000080:02000400:0.0:1789185515.659664:0:6488:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789185515.669745:0:6488:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789185515.669761:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789185515.669797:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f1a38b0e) 00000020:00000080:0.0:1789185515.669816:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789185515.751383:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789185515.751450:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1789185515.768868:0:6488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789185515.769344:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789185515.769352:0:6488:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789185515.769366:0:6488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a72884 00000020:01000004:0.0:1789185515.769373:0:6488:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789185515.769378:0:6488:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789185515.769383:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000028b2af8d from MGS 00000020:01000004:0.0:1789185515.769387:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789185515.769397:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f2883685) 00000020:00000080:0.0:1789185515.769407:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789185515.769477:0:6488:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000028b2af8d from MGS, refs=2 00080000:01000000:0.0:1789185515.769483:0:6488:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789185515.769488:0:6488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a72892 00000100:00100000:0.0:1789185515.770048:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789185515.770654:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789185515.770661:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789185515.775391:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789185515.775404:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789185515.783325:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185515.783654:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789185515.783661:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789185515.784599:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789185515.784618:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789185515.785137:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789185515.785144:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789185515.785888:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185515.785893:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185515.785894:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185515.787051:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185515.787055:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185515.787057:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185515.788033:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789185515.795768:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789185516.037114:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3443 MB/s 00000001:01000000:2.0:1789185516.287861:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3207 MB/s 00000001:01000000:3.0:1789185516.538305:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 402 MB/s 00000001:01000000:1.0:1789185516.788740:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 687 MB/s 00080000:10000000:1.0:1789185516.798231:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1789185516.829792:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789185516.831200:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789185516.831940:0:6488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789185516.832003:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789185516.832253:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789185516.832291:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789185516.832631:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185516.832799:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789185516.832806:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789185516.836061:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789185516.836073:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:3.0:1789185516.839015:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185516.839177:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789185516.839188:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789185516.840515:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789185516.840537:0:6488:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.148@tcp' 00000020:01000004:3.0:1789185516.840538:0:6488:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789185516.840592:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.148@tcp (typ=mgc) 00000020:00000080:3.0:1789185516.840617:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.148@tcp (00000000aa19bdef) 00000020:00000080:3.0:1789185516.840635:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789185516.840764:0:6488:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000872f7e50@MGC192.168.204.148@tcp: add connection 192.168.204.148@tcp at head 00010000:00010000:3.0:1789185516.840972:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.148@tcp-0 is initialized 00000040:01000000:3.0:1789185516.840979:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789185516.842880:0:6509:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:0.0:1789185516.843838:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1789185516.844456:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.148@tcp (uuid 9010c27d-11d2-44c0-a2e4-e8975764c875) 00000020:00000080:3.0:1789185516.844480:0:6488:0:(genops.c:1384:class_connect()) connect: client 9010c27d-11d2-44c0-a2e4-e8975764c875, cookie 0xda5c730d5a728a0 00000100:00080000:3.0:1789185516.844498:0:6488:0:(import.c:545:import_select_connection()) MGC192.168.204.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185516.844507:0:6488:0:(import.c:666:import_select_connection()) MGC192.168.204.148@tcp: import 00000000872f7e50 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185516.844549:0:6488:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000075710903 x1876096898302080/t0(0) o250->MGC192.168.204.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185516.844763:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075710903 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9010c27d-11d2-44c0-a2e4-e8975764c875:3634:1876096898302080:0@lo:250: 00000100:00100000:0.0:1789185516.844849:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185516.848111:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898302080 00000100:00100000:1.0:1789185516.848133:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898302080 00000100:00100000:1.0:1789185516.848205:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185516.848213:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c75e0a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1876096898302080:12345-0@lo:250: 00010000:00080000:1.0:1789185516.848254:0:6505:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 9010c27d-11d2-44c0-a2e4-e8975764c875@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:1.0:1789185516.848289:0:6505:0:(genops.c:1384:class_connect()) connect: client 9010c27d-11d2-44c0-a2e4-e8975764c875, cookie 0xda5c730d5a728a7 00000100:00080000:1.0:1789185516.848471:0:6505:0:(import.c:65:import_set_state_nolock()) 0000000015c1f699 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789185516.848777:0:6488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS 00000020:01000004:3.0:1789185516.848799:0:6488:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789185516.848819:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789185516.848833:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005a5157b2) 00000020:00000080:3.0:1789185516.848844:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789185516.853264:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c75e0a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+5:3634:x1876096898302080:12345-0@lo:250: Request processed in 5042us (8407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185516.853399:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789185516.853411:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.148@tcp: connect to target with instance 0 00000100:00080000:0.0:1789185516.853420:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789185516.853425:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789185516.853428:0:3634:0:(import.c:65:import_set_state_nolock()) 00000000872f7e50 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789185516.853432:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789185516.853442:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789185516.853448:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075710903 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9010c27d-11d2-44c0-a2e4-e8975764c875:3634:1876096898302080:0@lo:250: 00000100:00100000:1.0:1789185516.853579:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185516.871993:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185516.872489:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789185516.872496:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789185516.879685:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789185516.879700:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789185516.884641:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789185516.884655:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789185516.885430:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185516.885711:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789185516.885717:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789185516.886504:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789185516.886596:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789185517.053472:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185517.053746:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789185517.053753:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789185517.055475:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789185517.055488:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789185517.056501:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185517.056788:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789185517.056794:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789185517.057593:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789185517.057604:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789185517.060437:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185517.060625:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789185517.060641:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789185517.062477:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789185517.062491:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789185517.066852:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185517.067527:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789185517.067542:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789185517.075533:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789185517.075554:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789185517.137114:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185517.137505:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789185517.137512:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789185517.141689:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789185517.141706:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789185517.146319:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789185517.146337:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789185517.147390:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789185517.147419:0:6488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789185517.147425:0:6488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789185517.147528:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789185517.147567:0:6488:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.148@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789185517.147572:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789185517.147573:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789185517.147575:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185517.147576:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185517.147577:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185517.147578:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185517.147580:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185517.147581:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789185517.147582:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185517.147584:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185517.147585:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185517.147586:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185517.147588:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789185517.147590:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185517.147591:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789185517.147592:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185517.147593:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185517.147600:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185517.147601:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185517.147602:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185517.147602:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789185517.147603:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185517.147604:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185517.147604:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185517.147605:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185517.147638:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789185517.147655:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa1a1fbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302208:0@lo:253: 00000100:00100000:2.0:1789185517.147746:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.147795:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000003017d49e going to sleep for 11 seconds 00000100:00100000:1.0:1789185517.148640:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898302208 00000100:00100000:1.0:1789185517.148652:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898302208 00000100:00100000:1.0:1789185517.148706:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185517.148715:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f537b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+5:6488:x1876096898302208:12345-0@lo:253: 20000000:01000000:1.0:1789185517.148779:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789185517.148783:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789185517.149710:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789185517.149781:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789185517.150133:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185517.155800:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789185517.156397:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789185517.156403:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789185517.156409:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789185517.156412:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789185517.156425:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789185517.156638:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185517.156808:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789185517.156824:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789185517.156843:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789185517.156879:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789185517.156893:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789185517.157217:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789185517.157226:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789185517.157252:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789185517.157258:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789185517.157267:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789185517.157271:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789185517.157282:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789185517.157295:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789185517.157324:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789185517.157329:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789185517.157335:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185517.157436:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789185517.157445:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789185517.157460:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789185517.157474:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789185517.157486:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789185517.157495:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789185517.157520:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789185517.157527:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789185517.157538:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789185517.157551:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789185517.157565:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789185517.157572:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789185517.157595:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789185517.157603:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789185517.157629:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789185517.157646:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789185517.157710:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789185517.157733:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789185517.157741:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789185517.160160:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789185517.160402:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789185517.160429:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.148@tcp for mdt 20000000:01000000:1.0:1789185517.160432:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:1.0:1789185517.160445:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789185517.160451:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789185517.160463:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789185517.160469:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:1.0:1789185517.160480:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789185517.160488:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789185517.160499:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789185517.160512:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789185517.160538:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789185517.160541:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789185517.160545:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789185517.160601:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789185517.160603:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789185517.161145:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789185517.161322:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789185517.161345:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789185517.161360:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1789185517.161374:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789185517.161378:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789185517.161670:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789185517.161900:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789185517.162005:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789185517.162028:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789185517.162040:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789185517.162043:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789185517.162048:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789185517.162050:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789185517.162056:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789185517.162063:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789185517.164068:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789185517.169061:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789185517.178813:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789185517.178854:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789185517.178869:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789185517.178894:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789185517.178936:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.178955:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.178965:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.178989:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.178994:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.179001:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.179006:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bab71143 already unused, calling callback (00000000eaa7f15e) 00010000:00010000:2.0:1789185517.179009:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.179017:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.179029:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.179036:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.179053:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bab71143/0xda5c730d5a728b5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789185517.179069:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789185517.199535:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f537b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+5:6488:x1876096898302208:12345-0@lo:253: Request processed in 50814us (51782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185517.199557:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185517.201729:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa1a1fbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302208:0@lo:253: 10000000:01000000:3.0:1789185517.201751:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789185517.201754:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789185517.201756:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789185517.201758:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185517.201759:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789185517.201760:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185517.201761:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185517.201762:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185517.201763:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789185517.201765:0:6488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789185517.201783:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185517.201785:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789185517.201805:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000028b2af8d from lustre-MDT0000 10000000:01000000:3.0:1789185517.201836:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789185517.201839:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789185517.201843:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98f2c6fd4d40 10000000:01000000:3.0:1789185517.201847:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185517.201855:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98f2c6fd4d40 from 1 10000000:01000000:3.0:1789185517.201857:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789185517.201897:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.201923:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.201932:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185517.201948:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007770d9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302336:0@lo:101: 00000100:00100000:3.0:1789185517.202023:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185517.202106:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7b1d309 going to sleep for 11 seconds 00000100:00100000:1.0:1789185517.202528:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898302336 00000100:00100000:1.0:1789185517.202537:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898302336 00000100:00100000:1.0:1789185517.202585:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789185517.202593:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e2cca87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+5:6488:x1876096898302336:12345-0@lo:101: 00010000:00010000:1.0:1789185517.202605:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185517.202621:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a728bc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.202642:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a728bc expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.202651:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a728bc expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.202670:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000977a2020, rc 0) 00000100:00100000:1.0:1789185517.202720:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e2cca87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+6:6488:x1876096898302336:12345-0@lo:101: Request processed in 129us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185517.202726:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185517.202811:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007770d9ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302336:0@lo:101: 00010000:00010000:2.0:1789185517.202832:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.202840:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185517.202903:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302464:0@lo:501: 00000100:00100000:2.0:1789185517.202983:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.203006:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000308f67ec going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.203075:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898302464 00000100:00100000:0.0:1789185517.203080:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898302464 00000100:00100000:0.0:1789185517.203123:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185517.203129:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000880a8c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+6:6488:x1876096898302464:12345-0@lo:501: 00000100:00100000:0.0:1789185517.203208:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000880a8c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+6:6488:x1876096898302464:12345-0@lo:501: Request processed in 80us (226us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185517.203215:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185517.203451:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302464:0@lo:501: 10000000:01000000:2.0:1789185517.203488:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789185517.203510:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.203517:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185517.203526:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f2e7ae1000 10000000:01000000:2.0:1789185517.203530:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789185517.203533:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f2e7ae1000 10000000:01000000:2.0:1789185517.203535:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789185517.203538:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98f2e7ae1000 from 1 10000000:01000000:2.0:1789185517.203540:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789185517.203558:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000bab71143/0xda5c730d5a728ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.203564:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000bab71143/0xda5c730d5a728ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.203582:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000bab71143/0xda5c730d5a728ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185517.203594:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302592:0@lo:101: 00000100:00100000:2.0:1789185517.203620:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.203632:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000308f67ec going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.203726:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898302592 00000100:00100000:0.0:1789185517.203731:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898302592 00000100:00100000:0.0:1789185517.203751:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185517.203756:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ad953c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+6:6488:x1876096898302592:12345-0@lo:101: 00010000:00010000:0.0:1789185517.203763:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185517.203773:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001925271a/0xda5c730d5a728d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a728ca expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.203786:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001925271a/0xda5c730d5a728d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a728ca expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.203804:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001925271a/0xda5c730d5a728d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a728ca expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.203809:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001925271a, rc 0) 00000100:00100000:0.0:1789185517.203846:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ad953c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+7:6488:x1876096898302592:12345-0@lo:101: Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.203851:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789185517.203948:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302592:0@lo:101: 00010000:00010000:2.0:1789185517.203959:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000bab71143/0xda5c730d5a728ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.203966:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000bab71143/0xda5c730d5a728ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185517.203975:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789185517.203980:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000bab71143/0xda5c730d5a728ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.203985:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000bab71143/0xda5c730d5a728ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185517.203990:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789185517.203994:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789185517.203998:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f2e7ae1000 10000000:01000000:2.0:1789185517.204000:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789185517.204002:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789185517.204004:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789185517.204017:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.204033:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.204040:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185517.204051:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302720:0@lo:101: 00000100:00100000:2.0:1789185517.204074:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.204092:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000308f67ec going to sleep for 11 seconds 00000100:00100000:3.0:1789185517.204327:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898302720 00000100:00100000:3.0:1789185517.204333:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898302720 00000100:00100000:3.0:1789185517.204353:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185517.204358:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000471cfa15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+7:6488:x1876096898302720:12345-0@lo:101: 00010000:00010000:3.0:1789185517.204364:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185517.204372:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a728d8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.204385:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a728d8 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.204404:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a728d8 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.204409:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab99809d, rc 0) 00000100:00100000:3.0:1789185517.204447:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000471cfa15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+8:6488:x1876096898302720:12345-0@lo:101: Request processed in 89us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185517.204452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789185517.204801:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302720:0@lo:101: 00010000:00010000:2.0:1789185517.204812:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.204819:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185517.204869:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302848:0@lo:501: 00000100:00100000:2.0:1789185517.204898:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.204956:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000308f67ec going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.205034:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898302848 00000100:00100000:0.0:1789185517.205040:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898302848 00000100:00100000:0.0:1789185517.205071:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185517.205076:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069b86eff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+8:6488:x1876096898302848:12345-0@lo:501: 00000100:00100000:0.0:1789185517.205356:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069b86eff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6488:x1876096898302848:12345-0@lo:501: Request processed in 280us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.205363:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185517.205588:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302848:0@lo:501: 00000100:00100000:2.0:1789185517.205617:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302976:0@lo:503: 00000100:00100000:2.0:1789185517.205656:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.205679:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000308f67ec going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.205730:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898302976 00000100:00100000:0.0:1789185517.205734:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898302976 00000100:00100000:0.0:1789185517.205762:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789185517.205769:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000050255a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6488:x1876096898302976:12345-0@lo:503: 00000100:00100000:0.0:1789185517.205948:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000050255a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6488:x1876096898302976:12345-0@lo:503: Request processed in 179us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.205955:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185517.207537:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898302976:0@lo:503: 00000100:00100000:0.0:1789185517.208338:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b0235b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:6534:1876096898303104:0@lo:502: 00000100:00100000:0.0:1789185517.208413:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185517.208492:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046f06abe going to sleep for 11 seconds 00000100:00100000:1.0:1789185517.208537:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898303104 00000100:00100000:1.0:1789185517.208543:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898303104 00000100:00100000:1.0:1789185517.208638:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789185517.208646:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c748ac41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6534:x1876096898303104:12345-0@lo:502: 00000100:00100000:1.0:1789185517.208802:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c748ac41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6534:x1876096898303104:12345-0@lo:502: Request processed in 157us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185517.208810:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185517.208932:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b0235b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:6534:1876096898303104:0@lo:502: 00000020:01000000:0.0:1789185517.208959:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185517.208976:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185517.208978:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789185517.208983:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789185517.208986:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789185517.208999:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a654bc47) 00000020:00000080:0.0:1789185517.209018:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789185517.209023:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789185517.209714:0:6534:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789185517.209724:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a728ed 00000020:00000080:0.0:1789185517.210018:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789185517.210025:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185517.210030:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185517.210031:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789185517.210033:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185517.210103:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185517.210106:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789185517.210209:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789185517.210220:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000921960b3) 00000020:00000080:0.0:1789185517.210311:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789185517.210317:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789185517.210319:0:6534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789185517.210322:0:6534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789185517.210328:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789185517.210388:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000028b2af8d from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789185517.210410:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000401b454d) 00000020:00000080:0.0:1789185517.210418:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789185517.210489:0:6534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789185517.210496:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a72902 00000020:00000080:0.0:1789185517.210611:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789185517.210628:0:6534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789185517.210633:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xda5c730d5a72909 00080000:01000000:0.0:1789185517.210638:0:6534:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789185517.210642:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a72910 00080000:10000000:0.0:1789185517.211660:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789185517.211828:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789185517.216288:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789185517.299871:0:6534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789185517.301352:0:6534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789185517.304152:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789185517.304762:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789185517.314067:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ef37430c) 00000020:00000080:3.0:1789185517.314098:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789185517.314215:0:6534:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789185517.314223:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a7291e 00000020:00000080:3.0:1789185517.317294:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789185517.318087:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1789185517.322720:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789185517.326724:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789185517.329302:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1789185517.332494:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1789185517.338264:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789185517.340439:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xda5c730d5a72925 00000020:00000080:2.0:1789185517.342563:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789185517.342577:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185517.342587:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185517.342589:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789185517.342594:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185517.342598:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185517.342599:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789185517.342603:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789185517.342604:0:6534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789185517.342607:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185517.342609:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185517.342610:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789185517.342612:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185517.342616:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185517.342617:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789185517.342621:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789185517.342672:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789185517.342731:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:6534:1876096898303232:0@lo:502: 00000100:00100000:2.0:1789185517.342817:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.342879:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000339f860e going to sleep for 11 seconds 00000100:00100000:1.0:1789185517.343014:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898303232 00000100:00100000:1.0:1789185517.343023:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898303232 00000100:00100000:1.0:1789185517.343082:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185517.343090:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ddd5cd64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6534:x1876096898303232:12345-0@lo:502: 00000100:00100000:1.0:1789185517.343213:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ddd5cd64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6534:x1876096898303232:12345-0@lo:502: Request processed in 124us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185517.343221:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789185517.344521:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:6534:1876096898303232:0@lo:502: 00000020:01000000:2.0:1789185517.344562:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185517.344571:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185517.344573:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789185517.344578:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789185517.344674:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789185517.344701:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789185517.344723:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.344734:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185517.344741:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f2e7ae1000 from 1 10000000:01000000:3.0:1789185517.344744:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185517.344776:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.344790:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.344799:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185517.344816:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303360:0@lo:101: 00000100:00100000:3.0:1789185517.344873:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185517.344937:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293296ee going to sleep for 11 seconds 00000100:00100000:2.0:1789185517.345052:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898303360 00000100:00100000:2.0:1789185517.345059:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898303360 00000100:00100000:2.0:1789185517.345096:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789185517.345103:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002db9cfaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6488:x1876096898303360:12345-0@lo:101: 00010000:00010000:2.0:1789185517.345258:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185517.345272:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a7292c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.345295:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a7292c expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.345305:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7292c expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.345312:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000064cb80b, rc 0) 00000100:00100000:2.0:1789185517.345355:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002db9cfaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+10:6488:x1876096898303360:12345-0@lo:101: Request processed in 252us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185517.345362:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185517.345460:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303360:0@lo:101: 00010000:00010000:3.0:1789185517.345472:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.345479:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185517.346852:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303488:0@lo:256: 00000100:00100000:3.0:1789185517.346969:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185517.347058:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293296ee going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.347116:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898303488 00000100:00100000:0.0:1789185517.347125:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898303488 00000100:00100000:0.0:1789185517.347175:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185517.347183:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009be8d8bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+10:6488:x1876096898303488:12345-0@lo:256: 20000000:01000000:0.0:1789185517.347203:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789185517.347219:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789185517.347876:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009be8d8bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+10:6488:x1876096898303488:12345-0@lo:256: Request processed in 692us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.347886:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185517.348072:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303488:0@lo:256: 10000000:01000000:3.0:1789185517.348704:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789185517.348725:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.348736:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185517.348760:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2e7ae1000 from 1 10000000:01000000:3.0:1789185517.348763:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185517.348798:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.348806:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.348815:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185517.348833:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303616:0@lo:101: 00000100:00100000:3.0:1789185517.348870:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185517.349135:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293296ee going to sleep for 11 seconds 00000100:00100000:2.0:1789185517.349533:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898303616 00000100:00100000:2.0:1789185517.349540:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898303616 00000100:00100000:2.0:1789185517.349688:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789185517.349698:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000066cf37f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+10:6488:x1876096898303616:12345-0@lo:101: 00010000:00010000:2.0:1789185517.349713:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185517.349730:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a7293a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.349755:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a7293a expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.349765:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7293a expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.349783:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000900cfb1b, rc 0) 00000100:00100000:2.0:1789185517.349832:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000066cf37f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+11:6488:x1876096898303616:12345-0@lo:101: Request processed in 136us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185517.349839:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185517.350279:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303616:0@lo:101: 00010000:00010000:3.0:1789185517.350295:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.350304:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185517.350378:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303744:0@lo:501: 00000100:00100000:3.0:1789185517.350407:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185517.350426:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293296ee going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.350514:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898303744 00000100:00100000:0.0:1789185517.350519:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898303744 00000100:00100000:0.0:1789185517.350559:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789185517.350565:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b03d381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+11:6488:x1876096898303744:12345-0@lo:501: 00000100:00100000:0.0:1789185517.351105:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b03d381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+11:6488:x1876096898303744:12345-0@lo:501: Request processed in 540us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.351114:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185517.351196:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303744:0@lo:501: 00000100:00100000:3.0:1789185517.351238:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303872:0@lo:503: 00000100:00100000:3.0:1789185517.351290:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185517.351440:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293296ee going to sleep for 11 seconds 00000100:00100000:1.0:1789185517.351506:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898303872 00000100:00100000:1.0:1789185517.351513:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898303872 00000100:00100000:1.0:1789185517.351580:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185517.351586:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a3785d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+11:6488:x1876096898303872:12345-0@lo:503: 00000040:00080000:1.0:1789185517.351620:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789185517.351667:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a3785d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+11:6488:x1876096898303872:12345-0@lo:503: Request processed in 82us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185517.351673:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185517.351750:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898303872:0@lo:503: 00000040:00080000:2.0:1789185517.353770:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789185517.354215:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789185517.354249:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185517.354300:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.354314:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185517.354391:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789185517.354394:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f2e7ae1000 10000000:01000000:3.0:1789185517.354397:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f2e7ae1000 10000000:01000000:3.0:1789185517.354401:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185517.354408:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2e7ae1000 from 1 10000000:01000000:3.0:1789185517.354411:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789185517.354457:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.354466:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.354476:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185517.354500:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898304000:0@lo:101: 00000100:00100000:3.0:1789185517.354563:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185517.354610:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025a5f09c going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.354685:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898304000 00000100:00100000:0.0:1789185517.354691:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898304000 00000100:00100000:0.0:1789185517.354733:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789185517.354740:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f578ceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+11:6488:x1876096898304000:12345-0@lo:101: 00010000:00010000:0.0:1789185517.354751:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185517.354761:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72948 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.354784:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72948 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.354804:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72948 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.354813:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4b1636c, rc 0) 00000100:00100000:0.0:1789185517.354856:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f578ceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6488:x1876096898304000:12345-0@lo:101: Request processed in 117us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.354862:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789185517.355010:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898304000:0@lo:101: 00010000:00010000:3.0:1789185517.355022:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.355030:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185517.355082:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898304128:0@lo:501: 00000100:00100000:3.0:1789185517.355106:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185517.355135:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025a5f09c going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.355177:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898304128 00000100:00100000:0.0:1789185517.355181:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898304128 00000100:00100000:0.0:1789185517.355209:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789185517.355215:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005be7bb15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6488:x1876096898304128:12345-0@lo:501: 00000100:00100000:0.0:1789185517.355333:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005be7bb15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6488:x1876096898304128:12345-0@lo:501: Request processed in 118us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.355340:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789185517.355398:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdb017a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898304128:0@lo:501: 00000100:00100000:2.0:1789185517.355425:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898304256:0@lo:503: 00000100:00100000:2.0:1789185517.355463:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.355490:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3bb6b67 going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.355531:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898304256 00000100:00100000:0.0:1789185517.355535:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898304256 00000100:00100000:0.0:1789185517.355565:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789185517.355571:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e20b7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6488:x1876096898304256:12345-0@lo:503: 00000100:00100000:0.0:1789185517.355649:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e20b7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6488:x1876096898304256:12345-0@lo:503: Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.355655:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789185517.355725:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898304256:0@lo:503: 00000100:00100000:2.0:1789185517.356114:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:6539:1876096898304384:0@lo:502: 00000100:00100000:2.0:1789185517.356155:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.356182:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8419456 going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.356222:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898304384 00000100:00100000:0.0:1789185517.356236:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898304384 00000100:00100000:0.0:1789185517.356266:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789185517.356273:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009300d3bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6539:x1876096898304384:12345-0@lo:502: 00000100:00100000:0.0:1789185517.356348:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009300d3bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6539:x1876096898304384:12345-0@lo:502: Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.356360:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789185517.356431:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:6539:1876096898304384:0@lo:502: 00000020:01000004:2.0:1789185517.356483:0:6539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789185517.356505:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000008a404ae3) 00000020:00000080:2.0:1789185517.356524:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789185517.356616:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000028b2af8d from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789185517.356620:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000028b2af8d from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789185517.356622:0:6539:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000028b2af8d 4 00010000:00080000:2.0:1789185517.356660:0:6539:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b2f56d9b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.148@tcp at head 00010000:00010000:2.0:1789185517.361839:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789185517.362653:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789185517.362698:0:6539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789185517.362711:0:6539:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xda5c730d5a7295d 00000100:00080000:2.0:1789185517.362728:0:6539:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789185517.362739:0:6539:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b2f56d9b using connection 192.168.204.148@tcp/0@lo 00000100:00100000:2.0:1789185517.362773:0:6539:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000073df77a6 x1876096898304512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789185517.362790:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789185517.362900:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898304512:0@lo:38: 00000100:00100000:0.0:1789185517.362991:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.363033:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898304512 00000100:00100000:2.0:1789185517.363040:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898304512 00000100:00100000:2.0:1789185517.363085:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185517.363091:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b0235b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898304512:12345-0@lo:38: 00000100:00100000:2.0:1789185517.363163:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b0235b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898304512:12345-0@lo:38: Request processed in 70us (171us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789185517.363170:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185517.363188:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789185517.363195:0:3634:0:(import.c:65:import_set_state_nolock()) 00000000b2f56d9b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185517.363199:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789185517.363202:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898304512:0@lo:38: 00000100:00100000:2.0:1789185517.363500:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d7ccb2f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:6539:1876096898304640:0@lo:502: 00000100:00100000:2.0:1789185517.363540:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185517.363555:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf5e869e going to sleep for 11 seconds 00000100:00100000:0.0:1789185517.364600:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898304640 00000100:00100000:0.0:1789185517.364610:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898304640 00000100:00100000:0.0:1789185517.364661:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789185517.364668:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db48d0c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6539:x1876096898304640:12345-0@lo:502: 00000100:00100000:0.0:1789185517.364792:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db48d0c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6539:x1876096898304640:12345-0@lo:502: Request processed in 124us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185517.364801:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789185517.365077:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d7ccb2f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:6539:1876096898304640:0@lo:502: 00000040:00080000:1.0:1789185517.365331:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789185517.367251:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789185517.367288:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789185517.367311:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.367324:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789185517.367387:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789185517.367390:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789185517.367391:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185517.367392:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185517.367393:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185517.367395:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185517.367402:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789185517.367403:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789185517.367404:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789185517.367406:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789185517.367407:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185517.367408:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789185517.367411:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789185517.367414:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789185517.367415:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789185517.367415:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185517.367416:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185517.367417:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185517.367418:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185517.367419:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789185517.367419:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789185517.367420:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789185517.367421:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789185517.367422:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185517.367422:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789185517.367451:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789185517.367479:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d4cb3e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898304768:0@lo:253: 00000100:00100000:0.0:1789185517.367541:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185517.367589:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9172901 going to sleep for 11 seconds 00000100:00100000:3.0:1789185517.368000:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898304768 00000100:00100000:3.0:1789185517.368008:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898304768 00000100:00100000:3.0:1789185517.368059:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185517.368068:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d724f750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6488:x1876096898304768:12345-0@lo:253: 20000000:01000000:3.0:1789185517.368097:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789185517.368112:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789185517.375425:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789185517.375485:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789185517.375574:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789185517.375580:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789185517.375604:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.375627:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7292c expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.375634:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.375699:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a7292c expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.375720:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a7292c expref: 12 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185517.375735:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f7a1843 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898304896:0@lo:104: 00000100:00100000:1.0:1789185517.375804:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185517.375865:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f61c594c going to sleep for 11 seconds 00000100:00100000:2.0:1789185517.376027:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898304896 00000100:00100000:2.0:1789185517.376036:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898304896 00000100:00100000:2.0:1789185517.376084:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185517.376091:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034b5e73a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6528:x1876096898304896:12345-0@lo:104: 00010000:00010000:2.0:1789185517.376104:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185517.376353:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185517.376358:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034b5e73a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6528:x1876096898304896:12345-0@lo:104: Request processed in 268us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185517.376366:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185517.376935:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d724f750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6488:x1876096898304768:12345-0@lo:253: Request processed in 8867us (9392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185517.376944:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789185517.377089:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f7a1843 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898304896:0@lo:104: 00010000:00010000:1.0:1789185517.377109:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.377335:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185517.377341:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.377350:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c77712f8 already unused, calling callback (000000005a26ab53) 10000000:00010000:0.0:1789185517.377353:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.377361:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185517.377366:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185517.377387:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185517.377429:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.377436:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185517.377461:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.377468:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: 00000000c77712f8/0xda5c730d5a7292c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72933 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185517.377486:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185517.377487:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185517.377489:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185517.377516:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d4cb3e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:6488:1876096898304768:0@lo:253: 10000000:01000000:0.0:1789185517.377526:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789185517.377529:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789185517.377531:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789185517.377532:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185517.377534:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185517.377535:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185517.377536:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185517.377537:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789185517.377538:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789185517.377539:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789185517.377541:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789185517.377542:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185517.377543:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789185517.377554:0:6488:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789185517.377731:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e815dd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898305024:0@lo:103: 00000100:00100000:3.0:1789185517.377774:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185517.378313:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898305024 00000100:00100000:1.0:1789185517.378322:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898305024 00010000:00010000:1.0:1789185517.378354:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7292c expref: 12 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185517.378396:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185517.378405:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae19d08f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:3636:x1876096898305024:12345-0@lo:103: 00010000:00010000:1.0:1789185517.378419:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185517.378424:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7292c expref: 12 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378434:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a7292c expref: 12 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378746:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000064cb80b/0xda5c730d5a72933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a7292c expref: 12 pid: 6505 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378760:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378766:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789185517.378780:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003201916s 00010000:00010000:1.0:1789185517.378784:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378789:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378795:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378800:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378815:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ec5cb48a already unused, calling callback (00000000eaa7f15e) 00010000:00010000:1.0:1789185517.378818:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378824:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378844:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185517.378853:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185517.378899:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae19d08f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+11:3636:x1876096898305024:12345-0@lo:103: Request processed in 496us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185517.378935:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185517.378975:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e815dd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898305024:0@lo:103: 00010000:00010000:3.0:1789185517.379062:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.379071:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185517.379085:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ec5cb48a/0xda5c730d5a72964 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789185517.383617:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1789185517.383815:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789185517.384062:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1789185517.384236:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789185517.384433:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1789185517.384568:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789185517.386184:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789185517.386448:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789185517.386631:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789185517.386795:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789185517.387323:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789185517.387503:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789185517.391389:0:6488:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789185517.403220:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789185517.403359:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1789185517.403725:0:6544:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789185517.403730:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1789185517.408837:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789185517.410255:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789185517.411051:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789185517.412381:0:6488:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789185517.412396:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789185517.412560:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185517.413951:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789185517.414610:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789185517.414644:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789185517.414774:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:1.0:1789185517.414829:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789185517.414832:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789185517.414836:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:1.0:1789185517.415090:0:6488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1789185517.416799:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789185517.417315:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789185517.417507:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789185517.417659:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789185517.417801:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789185517.418504:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789185517.418690:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789185517.418839:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789185517.419014:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789185517.419146:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789185517.419356:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789185517.419490:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789185517.420206:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789185517.420508:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789185517.420682:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789185517.420819:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789185517.421196:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789185517.421435:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789185517.421569:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789185517.421698:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789185517.421856:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789185517.422189:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789185517.423093:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789185517.423275:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789185517.423413:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789185517.423542:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789185517.423671:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789185517.423812:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789185517.424483:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789185517.424680:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789185517.424824:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789185517.425404:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789185517.425608:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1789185517.429877:0:6488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789185517.429968:0:6488:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb21ac1a07988 00100000:10000000:1.0:1789185517.429977:0:6488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789185517.430790:0:6488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789185517.430806:0:6488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789185517.430844:0:6488:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789185517.430899:0:6488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789185517.433281:0:6488:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185517.433474:0:6488:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789185517.867207:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185518.887645:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185519.911101:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185520.934093:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789185521.704418:0:6789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789185521.958057:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185522.599034:0:497:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789185522.599044:0:497:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789185522.599047:0:497:0:(import.c:65:import_set_state_nolock()) 00000000b2f56d9b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789185522.599065:0:497:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b2f56d9b using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185522.599086:0:497:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000064272403 x1876096898305280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185522.599145:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f7a1843 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898305152:0@lo:400: 00000100:00100000:2.0:1789185522.599216:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185522.599348:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898305152 00000100:00100000:1.0:1789185522.599375:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898305152 00000100:00100000:1.0:1789185522.599428:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789185522.599437:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007afba5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+11:3637:x1876096898305152:12345-0@lo:400: 00000100:00100000:1.0:1789185522.599494:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007afba5a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+11:3637:x1876096898305152:12345-0@lo:400: Request processed in 57us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185522.599500:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789185522.599547:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f7a1843 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898305152:0@lo:400: 00000100:00100000:0.0:1789185522.599618:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064272403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898305280:0@lo:38: 00000100:00100000:0.0:1789185522.599675:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185522.599735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898305280 00000100:00100000:1.0:1789185522.599740:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898305280 00000100:00100000:1.0:1789185522.599761:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185522.599778:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008d4cb3e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876096898305280:12345-0@lo:38: 00010000:00080000:1.0:1789185522.599811:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:1.0:1789185522.599849:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xda5c730d5a7296b 00000004:00100000:1.0:1789185522.599893:0:6514:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789185522.600028:0:6514:0:(import.c:65:import_set_state_nolock()) 00000000d3b93ea1 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185522.600068:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008d4cb3e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876096898305280:12345-0@lo:38: Request processed in 289us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185522.600075:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789185522.600106:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000064272403 x1876096898305280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789185522.600119:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789185522.601453:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789185522.601464:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789185522.601469:0:3634:0:(import.c:65:import_set_state_nolock()) 00000000b2f56d9b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789185522.601477:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064272403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898305280:0@lo:38: 00000020:00000004:0.0:1789185522.715649:0:6841:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185522.715808:0:6841:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789185522.982478:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185524.006115:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185525.034615:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789185525.996160:0:6943:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789185525.996420:0:6943:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789185526.056084:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789185526.694782:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789185526.694791:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f2e7ae1000 from 3 10000000:01000000:1.0:1789185526.694796:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789185526.694848:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185526.694861:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185526.694872:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185526.694950:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064272403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898305408:0@lo:101: 00000100:00100000:1.0:1789185526.695027:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185526.695115:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035efe74f going to sleep for 11 seconds 00000100:00100000:3.0:1789185526.695361:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898305408 00000100:00100000:3.0:1789185526.695369:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898305408 00000100:00100000:3.0:1789185526.695427:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789185526.695434:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d89d9ed3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+11:6509:x1876096898305408:12345-0@lo:101: 00010000:00010000:3.0:1789185526.695446:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185526.695458:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72972 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185526.695482:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72972 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185526.695492:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72972 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185526.695500:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000588c98d5, rc 0) 00000100:00100000:3.0:1789185526.695541:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d89d9ed3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6509:x1876096898305408:12345-0@lo:101: Request processed in 108us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185526.695554:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789185526.695656:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064272403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898305408:0@lo:101: 00010000:00010000:0.0:1789185526.695681:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185526.695689:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185526.695742:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df705637 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898305536:0@lo:256: 00000100:00100000:0.0:1789185526.695779:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185526.695798:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f608f42 going to sleep for 11 seconds 00000100:00100000:2.0:1789185526.695976:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898305536 00000100:00100000:2.0:1789185526.695981:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898305536 00000100:00100000:2.0:1789185526.696016:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789185526.696022:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000abe9a9f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6509:x1876096898305536:12345-0@lo:256: 20000000:01000000:2.0:1789185526.696035:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789185526.696064:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789185526.696068:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789185526.696145:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000abe9a9f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:6509:x1876096898305536:12345-0@lo:256: Request processed in 124us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185526.696152:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789185526.696633:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df705637 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898305536:0@lo:256: 10000000:01000000:0.0:1789185526.696674:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789185526.696681:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185526.696689:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185527.079163:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185527.721173:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898305792:0@lo:400: 00000100:00100000:2.0:1789185527.721249:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185527.721316:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898305792 00000100:00100000:2.0:1789185527.721323:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898305792 00000100:00100000:2.0:1789185527.721368:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185527.721374:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004887a228 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898305792:12345-0@lo:400: 00000100:00100000:2.0:1789185527.721424:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004887a228 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898305792:12345-0@lo:400: Request processed in 50us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185527.721431:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789185527.721470:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c6761a23 x1876096898305792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185527.721483:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898305792:0@lo:400: 00000100:00100000:1.0:1789185527.721689:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185527.721708:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c951004d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898305664:0@lo:400: 00000100:00100000:1.0:1789185527.721743:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185527.722557:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898305664 00000100:00100000:2.0:1789185527.722565:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898305664 00000100:00100000:2.0:1789185527.722604:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185527.722610:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000092aaf745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:3637:x1876096898305664:12345-0@lo:400: 00000100:00100000:2.0:1789185527.722671:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000092aaf745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:3637:x1876096898305664:12345-0@lo:400: Request processed in 62us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185527.722678:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185527.722830:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c951004d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898305664:0@lo:400: 00010000:00010000:0.0:1789185528.103120:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185529.126033:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185530.155644:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185531.176364:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185532.198099:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185532.842084:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fed5e21f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898306048:0@lo:400: 00000100:00100000:3.0:1789185532.842158:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185532.842238:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898306048 00000100:00100000:3.0:1789185532.842246:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898306048 00000100:00100000:3.0:1789185532.842301:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185532.842310:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039debbdb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898306048:12345-0@lo:400: 00000100:00100000:3.0:1789185532.842360:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039debbdb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898306048:12345-0@lo:400: Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185532.842368:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789185532.842409:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fed5e21f x1876096898306048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185532.842557:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fed5e21f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898306048:0@lo:400: 00000100:00100000:2.0:1789185532.842978:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185532.842989:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f55276d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898305920:0@lo:400: 00000100:00100000:2.0:1789185532.843028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185532.843535:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898305920 00000100:00100000:1.0:1789185532.843543:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898305920 00000100:00100000:1.0:1789185532.843579:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789185532.843586:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004577347f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:3635:x1876096898305920:12345-0@lo:400: 00000100:00100000:1.0:1789185532.843633:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004577347f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:3635:x1876096898305920:12345-0@lo:400: Request processed in 47us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185532.843639:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789185532.844785:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f55276d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898305920:0@lo:400: 00010000:00010000:2.0:1789185533.222119:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185534.246104:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185535.272190:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185536.295095:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185537.319401:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185537.958141:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004cae2968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898306304:0@lo:400: 00000100:00100000:3.0:1789185537.958205:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185537.958263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898306304 00000100:00100000:3.0:1789185537.958269:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898306304 00000100:00100000:3.0:1789185537.958307:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185537.958389:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185537.958398:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fed5e21f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898306176:0@lo:400: 00000100:00100000:2.0:1789185537.958430:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185537.958460:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898306176 00000100:00100000:2.0:1789185537.958463:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898306176 00000100:00100000:2.0:1789185537.958486:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789185537.958492:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c53070f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+12:3637:x1876096898306176:12345-0@lo:400: 00000100:00100000:2.0:1789185537.958532:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c53070f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+12:3637:x1876096898306176:12345-0@lo:400: Request processed in 40us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185537.958538:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789185537.958579:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fed5e21f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898306176:0@lo:400: 00000100:00100000:3.0:1789185537.958661:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000538fb407 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898306304:12345-0@lo:400: 00000100:00100000:3.0:1789185537.958703:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000538fb407 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898306304:12345-0@lo:400: Request processed in 45us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185537.958709:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789185537.958786:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004cae2968 x1876096898306304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185537.958820:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004cae2968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898306304:0@lo:400: 00000020:01000004:1.0:1789185538.167796:0:7442:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789185538.167801:0:7442:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789185538.167803:0:7442:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789185538.168433:0:7442:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bf258cbf 00000020:01000004:1.0:1789185538.168449:0:7442:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789185538.168460:0:7442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789185538.168480:0:7442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000477376ae) 00000020:00000080:1.0:1789185538.168494:0:7442:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789185538.224145:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1789185538.224214:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789185538.264379:0:7442:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789185538.264614:0:7442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789185538.264627:0:7442:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789185538.264643:0:7442:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a72987 00000020:01000004:0.0:1789185538.264650:0:7442:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789185538.264673:0:7442:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.148@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789185538.264676:0:7442:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789185538.264682:0:7442:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789185538.264709:0:7442:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789185538.264713:0:7442:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.148@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789185538.279443:0:7442:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789185538.279484:0:7442:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.148@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1789185538.279488:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789185538.279491:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789185538.279492:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185538.279493:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185538.279498:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185538.279499:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185538.279500:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789185538.279502:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789185538.279503:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789185538.279504:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185538.279506:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789185538.279509:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1789185538.279511:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789185538.279512:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789185538.279513:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185538.279514:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185538.279515:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185538.279515:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185538.279516:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789185538.279517:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789185538.279518:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789185538.279518:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185538.279519:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789185538.279544:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789185538.279562:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f7a1843 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898306432:0@lo:253: 00000100:00100000:1.0:1789185538.279639:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185538.279756:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd2fe918 going to sleep for 11 seconds 00000100:00100000:2.0:1789185538.279802:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898306432 00000100:00100000:2.0:1789185538.279812:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898306432 00000100:00100000:2.0:1789185538.280083:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789185538.280092:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000063d27901 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898306432:12345-0@lo:253: 20000000:01000000:2.0:1789185538.280135:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789185538.280140:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1789185538.280144:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1789185538.280147:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1789185538.280178:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1789185538.280372:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185538.280514:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789185538.280529:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789185538.280545:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789185538.280559:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789185538.280573:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789185538.280629:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1789185538.280637:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1789185538.280650:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1789185538.280655:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1789185538.280668:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1789185538.280673:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1789185538.280684:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789185538.280696:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789185538.280796:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1789185538.280806:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:2.0:1789185538.280818:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1789185538.280995:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789185538.281014:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1789185538.281020:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:2.0:1789185538.281031:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1789185538.281035:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789185538.281044:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789185538.281056:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789185538.281064:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789185538.281134:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1789185538.281144:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1789185538.281156:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789185538.281169:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789185538.281181:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1789185538.281186:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1789185538.281202:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789185538.281219:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789185538.281223:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1789185538.281242:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789185538.281250:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789185538.281626:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789185538.281824:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789185538.282085:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.148@tcp for mdt 20000000:01000000:2.0:1789185538.282088:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:2.0:1789185538.282107:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789185538.282113:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789185538.282123:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789185538.282127:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:2.0:1789185538.282142:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789185538.282150:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1789185538.282163:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1789185538.282177:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1789185538.282231:0:6505:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1789185538.282239:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1789185538.282499:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1789185538.282651:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789185538.282667:0:6505:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.148@tcp for mdt 20000000:01000000:2.0:1789185538.282669:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:2.0:1789185538.282683:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789185538.282688:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789185538.282698:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789185538.282702:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:2.0:1789185538.282712:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789185538.282718:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1789185538.282730:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789185538.282744:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1789185538.282761:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789185538.282764:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789185538.282768:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789185538.282814:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789185538.282817:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789185538.283305:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789185538.283327:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789185538.283341:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789185538.283475:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789185538.283493:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789185538.283514:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789185538.283522:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789185538.283524:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789185538.284133:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789185538.284159:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789185538.284171:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1789185538.284339:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789185538.284356:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789185538.284384:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1789185538.284397:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789185538.284399:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789185538.284722:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789185538.284740:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789185538.284751:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789185538.285112:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1789185538.285133:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1789185538.285147:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1789185538.285158:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789185538.285160:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789185538.285172:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789185538.285177:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789185538.285435:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1789185538.285543:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789185538.298413:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789185538.298669:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.298690:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a728bc expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.298697:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a728d8 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.298703:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72948 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.298708:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.298758:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72948 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.298775:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72948 expref: 12 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.298791:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e299f495 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876096898306560:0@lo:104: 00000100:00100000:1.0:1789185538.298873:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185538.299344:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a728d8 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.299354:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a728d8 expref: 12 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.299362:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876096898306688:0@lo:104: 00000100:00100000:1.0:1789185538.299386:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185538.299711:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a728bc expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.299719:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a728bc expref: 12 pid: 6505 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.299727:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d577a75b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876096898306816:0@lo:104: 00000100:00100000:1.0:1789185538.299750:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.299842:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898306560 00000100:00100000:2.0:1789185538.299850:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898306560 00000100:00100000:2.0:1789185538.299891:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898306688 00000100:00100000:2.0:1789185538.299893:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898306688 00000100:00100000:2.0:1789185538.299939:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185538.299948:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f0af41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6505:x1876096898306560:12345-0@lo:104: 00010000:00010000:2.0:1789185538.299969:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300028:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185538.300033:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f0af41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6505:x1876096898306560:12345-0@lo:104: Request processed in 86us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.300040:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185538.300058:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185538.300064:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000709b8d05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6505:x1876096898306688:12345-0@lo:104: 00010000:00010000:2.0:1789185538.300071:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300103:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789185538.300106:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000709b8d05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6505:x1876096898306688:12345-0@lo:104: Request processed in 44us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.300111:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789185538.300127:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185538.300131:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300139:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000dee6d62 already unused, calling callback (000000005a26ab53) 10000000:00010000:2.0:1789185538.300142:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300150:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185538.300156:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185538.300171:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185538.300197:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300204:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185538.300220:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300226:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a7294f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300236:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185538.300238:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300243:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a09bc03f already unused, calling callback (000000005a26ab53) 10000000:00010000:2.0:1789185538.300246:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300251:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185538.300257:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185538.300262:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185538.300272:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300278:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185538.300298:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300303:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a728d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a728df expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300314:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185538.300316:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185538.300317:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185538.300324:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185538.300336:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898306944:0@lo:103: 00000100:00100000:2.0:1789185538.300363:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.300391:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000085d048c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898307072:0@lo:103: 00000100:00100000:2.0:1789185538.300411:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.300444:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898306944 00000100:00100000:2.0:1789185538.300448:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898306944 00010000:00010000:2.0:1789185538.300463:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72948 expref: 13 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.300482:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898307072 00000100:00100000:2.0:1789185538.300485:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898307072 00010000:00010000:2.0:1789185538.300492:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a728d8 expref: 14 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.300503:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185538.300509:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf734bb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+14:3635:x1876096898306944:12345-0@lo:103: 00010000:00010000:2.0:1789185538.300518:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185538.300522:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72948 expref: 14 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300541:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72948 expref: 14 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300555:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185538.300581:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf734bb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+14:3635:x1876096898306944:12345-0@lo:103: Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.300588:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185538.300601:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185538.300606:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ab55337 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+13:3637:x1876096898307072:12345-0@lo:103: 00010000:00010000:2.0:1789185538.300613:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185538.300616:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a728d8 expref: 13 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300623:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a728d8 expref: 13 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.300631:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185538.300653:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ab55337 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+13:3637:x1876096898307072:12345-0@lo:103: Request processed in 48us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.300658:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185538.300695:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000085d048c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898307072:0@lo:103: 00000100:00100000:2.0:1789185538.300717:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898306944:0@lo:103: 00000100:00100000:1.0:1789185538.300923:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 0000000008faf5d8 going to sleep for 11 seconds 00010000:00010000:1.0:1789185538.300938:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4b1636c/0xda5c730d5a7294f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72948 expref: 12 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.300948:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e299f495 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876096898306560:0@lo:104: 00010000:00010000:1.0:1789185538.300966:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab99809d/0xda5c730d5a728df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a728d8 expref: 11 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.300974:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876096898306688:0@lo:104: 00000100:00100000:2.0:1789185538.301081:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898306816 00000100:00100000:2.0:1789185538.301086:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898306816 00000100:00100000:2.0:1789185538.301103:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185538.301108:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b988e10c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6505:x1876096898306816:12345-0@lo:104: 00010000:00010000:2.0:1789185538.301124:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301171:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185538.301175:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b988e10c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6505:x1876096898306816:12345-0@lo:104: Request processed in 67us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.301181:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789185538.301194:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185538.301197:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301204:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c06ece8d already unused, calling callback (000000005a26ab53) 10000000:00010000:2.0:1789185538.301206:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301212:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185538.301217:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185538.301222:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185538.301237:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301242:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185538.301250:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301255:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: 00000000c06ece8d/0xda5c730d5a728bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a728c3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301272:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185538.301274:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185538.301275:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185538.301280:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185538.301288:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898307200:0@lo:103: 00000100:00100000:2.0:1789185538.301312:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.301337:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898307200 00000100:00100000:2.0:1789185538.301341:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898307200 00010000:00010000:2.0:1789185538.301354:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a728bc expref: 11 pid: 6505 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.301372:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185538.301378:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000085d048c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+11:3637:x1876096898307200:12345-0@lo:103: 00010000:00010000:2.0:1789185538.301385:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185538.301388:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a728bc expref: 11 pid: 6505 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301395:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a728bc expref: 11 pid: 6505 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301405:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301411:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301422:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301440:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301444:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301449:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301453:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c7f13246 already unused, calling callback (00000000eaa7f15e) 00010000:00010000:2.0:1789185538.301456:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301461:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301467:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.301475:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185538.301499:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000085d048c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+11:3637:x1876096898307200:12345-0@lo:103: Request processed in 122us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.301505:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185538.301531:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898307200:0@lo:103: 00010000:00010000:1.0:1789185538.301583:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000977a2020/0xda5c730d5a728c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a728bc expref: 10 pid: 6505 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.301594:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d577a75b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876096898306816:0@lo:104: 00010000:00010000:1.0:1789185538.301612:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.301620:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.301625:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.301630:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c7f13246/0xda5c730d5a7298e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789185538.301644:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:1.0:1789185538.302615:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185538.303509:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000063d27901 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+9:7442:x1876096898306432:12345-0@lo:253: Request processed in 23412us (23864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.303520:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789185538.303604:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f7a1843 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898306432:0@lo:253: 10000000:01000000:2.0:1789185538.303618:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789185538.303621:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185538.303623:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789185538.303624:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185538.303635:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789185538.303636:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185538.303637:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185538.303639:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185538.303640:0:7442:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789185538.303641:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185538.303643:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789185538.303660:0:7442:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bf258cbf from lustre-MDT0001 10000000:01000000:2.0:1789185538.303690:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789185538.303693:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789185538.303699:0:7442:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f2c6fd4d40 local copy 10000000:01000000:2.0:1789185538.303703:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789185538.303736:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.303746:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.303755:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.303782:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307328:0@lo:101: 00000100:00100000:2.0:1789185538.303817:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.304033:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc3bb7a6 going to sleep for 11 seconds 00000100:00100000:1.0:1789185538.304857:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898307328 00000100:00100000:1.0:1789185538.304865:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898307328 00000100:00100000:1.0:1789185538.304971:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789185538.304980:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003304bd9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+9:7442:x1876096898307328:12345-0@lo:101: 00010000:00010000:1.0:1789185538.304994:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185538.305017:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee28432d/0xda5c730d5a7299c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72995 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.305040:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee28432d/0xda5c730d5a7299c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72995 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.305049:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee28432d/0xda5c730d5a7299c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72995 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.305057:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee28432d, rc 0) 00000100:00100000:1.0:1789185538.305111:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003304bd9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+10:7442:x1876096898307328:12345-0@lo:101: Request processed in 133us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.305118:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789185538.305217:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307328:0@lo:101: 00010000:00010000:2.0:1789185538.305231:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.305239:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.305340:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307456:0@lo:501: 00000100:00100000:2.0:1789185538.305381:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.305648:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc3bb7a6 going to sleep for 11 seconds 00000100:00100000:3.0:1789185538.305699:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898307456 00000100:00100000:3.0:1789185538.305705:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898307456 00000100:00100000:3.0:1789185538.305730:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185538.305736:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b6ecd44f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+10:7442:x1876096898307456:12345-0@lo:501: 00000100:00100000:3.0:1789185538.305812:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b6ecd44f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+10:7442:x1876096898307456:12345-0@lo:501: Request processed in 77us (432us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185538.305819:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789185538.306042:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307456:0@lo:501: 10000000:01000000:2.0:1789185538.306056:0:7442:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789185538.306075:0:7442:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789185538.306080:0:7442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306087:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306093:0:7442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306115:0:7442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789185538.306137:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f30030e800 10000000:01000000:2.0:1789185538.306141:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789185538.306146:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98f2c6fd4d40 10000000:01000000:2.0:1789185538.306148:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789185538.306151:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98f2c6fd4d40 from 1 10000000:01000000:2.0:1789185538.306153:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789185538.306170:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000570cd34a/0xda5c730d5a729a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306176:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000570cd34a/0xda5c730d5a729a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306183:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000570cd34a/0xda5c730d5a729a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.306207:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307584:0@lo:101: 00000100:00100000:2.0:1789185538.306231:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.306253:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898307584 00000100:00100000:2.0:1789185538.306257:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898307584 00000100:00100000:2.0:1789185538.306274:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185538.306279:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e11f4453 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+10:7442:x1876096898307584:12345-0@lo:101: 00010000:00010000:2.0:1789185538.306286:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185538.306294:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000037fafa09/0xda5c730d5a729aa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a729a3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306308:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037fafa09/0xda5c730d5a729aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a729a3 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306315:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000037fafa09/0xda5c730d5a729aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a729a3 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306321:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000037fafa09, rc 0) 00000100:00100000:2.0:1789185538.306346:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e11f4453 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+11:7442:x1876096898307584:12345-0@lo:101: Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.306352:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185538.306374:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e52fe3ff going to sleep for 11 seconds 00000100:00100000:2.0:1789185538.306384:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307584:0@lo:101: 00010000:00010000:2.0:1789185538.306393:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000570cd34a/0xda5c730d5a729a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729aa expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306399:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000570cd34a/0xda5c730d5a729a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a729aa expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185538.306424:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789185538.306433:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000570cd34a/0xda5c730d5a729a3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729aa expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306439:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000570cd34a/0xda5c730d5a729a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729aa expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185538.306446:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f30030e800 10000000:01000000:2.0:1789185538.306448:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789185538.306450:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98f30030e800 from 1 10000000:01000000:2.0:1789185538.306453:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789185538.306464:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000a37d64f8/0xda5c730d5a729b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306470:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000a37d64f8/0xda5c730d5a729b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306476:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000a37d64f8/0xda5c730d5a729b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.306486:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307712:0@lo:101: 00000100:00100000:2.0:1789185538.306507:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.306526:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898307712 00000100:00100000:2.0:1789185538.306530:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898307712 00000100:00100000:2.0:1789185538.306547:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789185538.306551:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073d8496d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+11:7442:x1876096898307712:12345-0@lo:101: 00010000:00010000:2.0:1789185538.306557:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185538.306563:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b58f2030/0xda5c730d5a729b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a729b1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306580:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b58f2030/0xda5c730d5a729b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a729b1 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306587:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b58f2030/0xda5c730d5a729b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a729b1 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306592:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b58f2030, rc 0) 00000100:00100000:2.0:1789185538.306614:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073d8496d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898307712:12345-0@lo:101: Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.306620:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789185538.306640:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e52fe3ff going to sleep for 11 seconds 00000100:00100000:2.0:1789185538.306650:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307712:0@lo:101: 00010000:00010000:2.0:1789185538.306658:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000a37d64f8/0xda5c730d5a729b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306664:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000a37d64f8/0xda5c730d5a729b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185538.306672:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789185538.306675:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000a37d64f8/0xda5c730d5a729b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306679:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000a37d64f8/0xda5c730d5a729b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185538.306684:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789185538.306687:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789185538.306690:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f30030e800 10000000:01000000:2.0:1789185538.306696:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789185538.306699:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789185538.306701:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789185538.306712:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 0000000035fbf759/0xda5c730d5a729bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306718:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 0000000035fbf759/0xda5c730d5a729bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.306724:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 0000000035fbf759/0xda5c730d5a729bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.306734:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307840:0@lo:101: 00000100:00100000:2.0:1789185538.306755:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185538.306999:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185538.307004:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.307012:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003601d35d already unused, calling callback (000000005a26ab53) 10000000:00010000:3.0:1789185538.307015:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.307023:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185538.307028:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185538.307033:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185538.307049:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.307065:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185538.307086:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.307091:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xda5c730d5a7299c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.307104:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185538.307106:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185538.307107:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185538.307201:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898307840 00000100:00100000:3.0:1789185538.307205:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898307840 00000100:00100000:3.0:1789185538.307224:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789185538.307228:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000747bfbdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898307840:12345-0@lo:101: 00010000:00010000:3.0:1789185538.307234:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185538.307241:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a87270f/0xda5c730d5a729c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a729bf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.307253:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a87270f/0xda5c730d5a729c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a729bf expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.307260:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a87270f/0xda5c730d5a729c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a729bf expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.307267:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a87270f, rc 0) 00000100:00100000:2.0:1789185538.307321:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006eda2020 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898307968:0@lo:103: 00000100:00100000:3.0:1789185538.307468:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000747bfbdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+13:7442:x1876096898307840:12345-0@lo:101: Request processed in 239us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185538.307473:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789185538.307560:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.307627:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e52fe3ff going to sleep for 11 seconds 00000100:00100000:2.0:1789185538.307639:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898307840:0@lo:101: 00010000:00010000:2.0:1789185538.307647:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 0000000035fbf759/0xda5c730d5a729bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.307654:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 0000000035fbf759/0xda5c730d5a729bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.307718:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308096:0@lo:501: 00000100:00100000:2.0:1789185538.307740:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.307794:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e52fe3ff going to sleep for 11 seconds 00000100:00100000:3.0:1789185538.307898:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898307968 00000100:00100000:3.0:1789185538.307903:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898307968 00000100:00100000:3.0:1789185538.308068:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185538.308074:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ecf2437e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+13:3635:x1876096898307968:12345-0@lo:103: 00010000:00010000:3.0:1789185538.308083:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185538.308093:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee28432d/0xda5c730d5a7299c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72995 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.308102:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185538.308127:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ecf2437e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+12:3635:x1876096898307968:12345-0@lo:103: Request processed in 54us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185538.308133:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185538.308197:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006eda2020 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898307968:0@lo:103: 00000100:00100000:1.0:1789185538.308271:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898308096 00000100:00100000:1.0:1789185538.308275:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898308096 00000100:00100000:1.0:1789185538.308303:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789185538.308309:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000766cdcfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898308096:12345-0@lo:501: 00000100:00100000:1.0:1789185538.308501:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000766cdcfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898308096:12345-0@lo:501: Request processed in 192us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.308508:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789185538.308614:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308096:0@lo:501: 00000100:00100000:2.0:1789185538.308644:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308224:0@lo:503: 00000100:00100000:2.0:1789185538.308683:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.308742:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e52fe3ff going to sleep for 11 seconds 00000100:00100000:0.0:1789185538.308774:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898308224 00000100:00100000:0.0:1789185538.308779:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898308224 00000100:00100000:0.0:1789185538.308848:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789185538.308855:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa8b02d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898308224:12345-0@lo:503: 00000100:00100000:0.0:1789185538.308974:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa8b02d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898308224:12345-0@lo:503: Request processed in 119us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185538.308981:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789185538.309054:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308224:0@lo:503: 00000040:00080000:2.0:1789185538.309345:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789185538.309427:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308352:0@lo:502: 00000100:00100000:2.0:1789185538.309459:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.309820:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e52fe3ff going to sleep for 11 seconds 00000100:00100000:3.0:1789185538.309975:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898308352 00000100:00100000:3.0:1789185538.309981:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898308352 00000100:00100000:1.0:1789185538.310193:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789185538.310200:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da01560b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898308352:12345-0@lo:502: 00000100:00100000:1.0:1789185538.310316:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da01560b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898308352:12345-0@lo:502: Request processed in 116us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.310324:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789185538.310391:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308352:0@lo:502: 00000040:00080000:3.0:1789185538.310618:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789185538.310646:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789185538.310659:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789185538.310669:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789185538.310679:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789185538.310689:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789185538.310699:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789185538.310713:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789185538.310724:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789185538.310734:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789185538.310744:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789185538.310756:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789185538.310769:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789185538.310781:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789185538.310793:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789185538.310805:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789185538.310844:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1789185538.310859:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1789185538.310885:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1789185538.310900:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1789185538.310946:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789185538.310961:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789185538.310974:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789185538.311003:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c539e053 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308480:0@lo:502: 00000100:00100000:3.0:1789185538.311046:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185538.311220:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000004fe07779 going to sleep for 11 seconds 00000100:00100000:2.0:1789185538.311358:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898308480 00000100:00100000:2.0:1789185538.311365:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898308480 00000100:00100000:2.0:1789185538.311393:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789185538.311400:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ace4a8c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898308480:12345-0@lo:502: 00000100:00100000:2.0:1789185538.311498:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ace4a8c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898308480:12345-0@lo:502: Request processed in 98us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.311505:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789185538.311579:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c539e053 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308480:0@lo:502: 00000040:00080000:3.0:1789185538.311620:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789185538.311628:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1789185538.312465:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185538.312477:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185538.312479:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789185538.312485:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789185538.312494:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185538.312507:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000076db8c14) 00000020:00000080:1.0:1789185538.312527:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1789185538.312532:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789185538.312618:0:7454:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789185538.312625:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a729d4 00000020:00000080:1.0:1789185538.312992:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789185538.312997:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185538.313001:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185538.313002:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789185538.313005:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185538.313009:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185538.313010:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789185538.313014:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185538.313021:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000001af5a527) 00000020:00000080:1.0:1789185538.313032:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1789185538.313036:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789185538.313037:0:7454:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789185538.313040:0:7454:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789185538.313046:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789185538.313088:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bf258cbf from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789185538.313098:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000752bbded) 00000020:00000080:1.0:1789185538.313105:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1789185538.313163:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789185538.313168:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a729e9 00000020:00000080:1.0:1789185538.313251:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789185538.313256:0:7454:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789185538.313260:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xda5c730d5a729f0 00080000:01000000:1.0:1789185538.313265:0:7454:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789185538.313267:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a729f7 00080000:10000000:1.0:1789185538.313653:0:7454:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789185538.313769:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1789185538.342392:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185538.428677:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789185538.428988:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789185538.431894:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789185538.432306:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789185538.449130:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789185538.449144:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185538.449151:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185538.449154:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789185538.449158:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185538.449164:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185538.449165:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789185538.449168:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789185538.449173:0:7454:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:00000080:2.0:1789185538.449201:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185538.449217:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000bbb910f7) 00000020:00000080:2.0:1789185538.449260:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789185538.449266:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789185538.449345:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789185538.449351:0:7454:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789185538.449358:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a72a05 00010000:00080000:2.0:1789185538.449388:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000038ca6053@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.148@tcp at head 00010000:00010000:2.0:1789185538.452636:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789185538.457596:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789185538.457611:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789185538.457672:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789185538.457692:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a72a0c 00000100:00080000:3.0:1789185538.457705:0:7454:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185538.457717:0:7454:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000038ca6053 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185538.457753:0:7454:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c539e053 x1876096898308608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185538.457961:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c539e053 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898308608:0@lo:38: 00000100:00100000:1.0:1789185538.458029:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.458133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898308608 00000100:00100000:2.0:1789185538.458140:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898308608 00000100:00100000:2.0:1789185538.458170:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185538.458175:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d577a75b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898308608:12345-0@lo:38: 00010000:00080000:2.0:1789185538.458199:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:2.0:1789185538.458241:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a72a13 00000004:00100000:2.0:1789185538.458255:0:6517:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789185538.458260:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789185538.458452:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789185538.458569:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185538.458574:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185538.458577:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789185538.458587:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789185538.458590:0:7454:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789185538.458591:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789185538.458593:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789185538.458594:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789185538.458596:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185538.458597:0:7454:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789185538.458599:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185538.458604:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185538.458605:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789185538.458609:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789185538.458645:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789185538.458657:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185538.458660:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185538.458661:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789185538.458663:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185538.458665:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185538.458666:0:7454:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789185538.458668:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789185538.458671:0:7454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789185538.458692:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185538.458696:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185538.458697:0:7454:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789185538.458699:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1789185538.458814:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789185538.458989:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789185538.459106:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 0000000035fbf759/0xda5c730d5a729bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.459118:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 0000000035fbf759/0xda5c730d5a729bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185538.459126:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f30030e800 from 1 10000000:01000000:3.0:1789185538.459137:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185538.459166:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.459173:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.459181:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185538.459196:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000697ff2bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308736:0@lo:101: 00000100:00100000:3.0:1789185538.459247:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185538.459293:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000004385e398 going to sleep for 11 seconds 00000100:00100000:1.0:1789185538.460163:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898308736 00000100:00100000:1.0:1789185538.460174:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898308736 00000100:00100000:1.0:1789185538.460221:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789185538.460227:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000517863cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+12:7442:x1876096898308736:12345-0@lo:101: 00010000:00010000:1.0:1789185538.460241:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185538.460253:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72a1a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.460276:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72a1a expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.460285:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a1a expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.460292:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7f13246, rc 0) 00000100:00100000:1.0:1789185538.460339:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000517863cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+13:7442:x1876096898308736:12345-0@lo:101: Request processed in 112us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.460345:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789185538.460639:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000697ff2bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308736:0@lo:101: 00010000:00010000:3.0:1789185538.460655:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.460663:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185538.461333:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000697ff2bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308864:0@lo:256: 00000100:00100000:3.0:1789185538.461381:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185538.461415:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000004385e398 going to sleep for 11 seconds 00000100:00100000:1.0:1789185538.461623:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898308864 00000100:00100000:1.0:1789185538.461630:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898308864 00000100:00100000:1.0:1789185538.461666:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789185538.461672:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000250c3955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+13:7442:x1876096898308864:12345-0@lo:256: 20000000:01000000:1.0:1789185538.461686:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789185538.462626:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789185538.462633:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789185538.462880:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000250c3955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+13:7442:x1876096898308864:12345-0@lo:256: Request processed in 1090us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.462902:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789185538.463014:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000697ff2bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308864:0@lo:256: 10000000:01000000:1.0:1789185538.463578:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789185538.465224:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.465243:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185538.465252:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f30030e800 from 1 10000000:01000000:1.0:1789185538.465255:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789185538.465293:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.465301:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.465311:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.465333:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308992:0@lo:101: 00000100:00100000:1.0:1789185538.465393:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185538.465483:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a83636ac going to sleep for 11 seconds 00000100:00100000:1.0:1789185538.466212:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898308992 00000100:00100000:1.0:1789185538.466221:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898308992 00000100:00100000:1.0:1789185538.466277:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789185538.466283:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000023815ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+13:7442:x1876096898308992:12345-0@lo:101: 00010000:00010000:1.0:1789185538.466297:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185538.466322:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72a28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.466347:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72a28 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.466357:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a28 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.466363:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee28432d, rc 0) 00000100:00100000:1.0:1789185538.466413:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000023815ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+14:7442:x1876096898308992:12345-0@lo:101: Request processed in 131us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.466421:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789185538.466470:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898308992:0@lo:101: 00010000:00010000:1.0:1789185538.466484:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.466492:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.466596:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309120:0@lo:501: 00000100:00100000:1.0:1789185538.466627:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185538.466650:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a83636ac going to sleep for 11 seconds 00000100:00100000:1.0:1789185538.466664:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898309120 00000100:00100000:1.0:1789185538.466667:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898309120 00000100:00100000:1.0:1789185538.466689:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789185538.466695:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089a811f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:7442:x1876096898309120:12345-0@lo:501: 00000100:00100000:1.0:1789185538.466952:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089a811f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:7442:x1876096898309120:12345-0@lo:501: Request processed in 256us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.466968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789185538.466999:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309120:0@lo:501: 00000100:00100000:1.0:1789185538.467023:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309248:0@lo:503: 00000100:00100000:1.0:1789185538.467059:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185538.467070:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a83636ac going to sleep for 11 seconds 00000100:00100000:1.0:1789185538.467081:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898309248 00000100:00100000:1.0:1789185538.467084:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898309248 00000100:00100000:1.0:1789185538.467102:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789185538.467108:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005dedd393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:7442:x1876096898309248:12345-0@lo:503: 00000040:00080000:1.0:1789185538.467149:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789185538.467182:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005dedd393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:7442:x1876096898309248:12345-0@lo:503: Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.467188:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789185538.467223:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309248:0@lo:503: 00000040:00080000:1.0:1789185538.467463:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185538.467504:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1789185538.467572:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185538.468659:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1789185538.468702:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789185538.468722:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185538.468736:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.468746:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185538.469571:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789185538.469583:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f30030e800 10000000:01000000:1.0:1789185538.469586:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f30030e800 10000000:01000000:1.0:1789185538.469590:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789185538.469596:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f30030e800 from 1 10000000:01000000:1.0:1789185538.469598:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789185538.469632:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 000000003b522bee/0xda5c730d5a72a36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.469641:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 000000003b522bee/0xda5c730d5a72a36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.469650:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 000000003b522bee/0xda5c730d5a72a36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.469671:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309376:0@lo:101: 00000100:00100000:1.0:1789185538.469728:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185538.469898:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000feef2db7 going to sleep for 11 seconds 00000100:00100000:0.0:1789185538.470145:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898309376 00000100:00100000:0.0:1789185538.470153:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898309376 00000100:00100000:0.0:1789185538.470201:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789185538.470209:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac9bac43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:7442:x1876096898309376:12345-0@lo:101: 00010000:00010000:0.0:1789185538.470221:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185538.470232:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043c2b12d/0xda5c730d5a72a3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72a36 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185538.470265:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043c2b12d/0xda5c730d5a72a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72a36 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185538.470274:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043c2b12d/0xda5c730d5a72a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a36 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185538.470282:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043c2b12d, rc 0) 00000100:00100000:0.0:1789185538.470330:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac9bac43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898309376:12345-0@lo:101: Request processed in 122us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185538.470336:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789185538.470422:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b9fb721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309376:0@lo:101: 00010000:00010000:2.0:1789185538.470436:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 000000003b522bee/0xda5c730d5a72a36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185538.470444:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 000000003b522bee/0xda5c730d5a72a36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185538.470543:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d974144c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309504:0@lo:501: 00000100:00100000:2.0:1789185538.470569:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.470596:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d04181bd going to sleep for 11 seconds 00000100:00100000:0.0:1789185538.471270:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898309504 00000100:00100000:0.0:1789185538.471278:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898309504 00000100:00100000:0.0:1789185538.471310:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789185538.471318:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c3a9982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898309504:12345-0@lo:501: 00000100:00100000:0.0:1789185538.471422:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c3a9982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898309504:12345-0@lo:501: Request processed in 105us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185538.471429:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789185538.471534:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d974144c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309504:0@lo:501: 00000100:00100000:2.0:1789185538.471564:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d974144c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309632:0@lo:503: 00000100:00100000:2.0:1789185538.471607:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.471633:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d04181bd going to sleep for 11 seconds 00000100:00100000:0.0:1789185538.471753:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898309632 00000100:00100000:0.0:1789185538.471757:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898309632 00000100:00100000:0.0:1789185538.471789:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789185538.471795:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006c4edd02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898309632:12345-0@lo:503: 00000100:00100000:0.0:1789185538.471884:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006c4edd02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898309632:12345-0@lo:503: Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185538.471890:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789185538.471950:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d974144c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309632:0@lo:503: 00000040:00080000:0.0:1789185538.472184:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789185538.472245:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df705637 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309760:0@lo:502: 00000100:00100000:0.0:1789185538.472275:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185538.472289:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089fad80a going to sleep for 11 seconds 00000100:00100000:0.0:1789185538.472302:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898309760 00000100:00100000:0.0:1789185538.472305:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898309760 00000100:00100000:0.0:1789185538.472322:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789185538.472327:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014e3b833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898309760:12345-0@lo:502: 00000100:00100000:0.0:1789185538.472390:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014e3b833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898309760:12345-0@lo:502: Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185538.472396:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789185538.472429:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df705637 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309760:0@lo:502: 00000040:00080000:0.0:1789185538.472636:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789185538.472659:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789185538.472672:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789185538.472684:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789185538.472696:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789185538.472710:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789185538.472722:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789185538.472732:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789185538.472743:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789185538.472755:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789185538.472768:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789185538.472782:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789185538.472794:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789185538.472807:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789185538.472820:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789185538.472847:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789185538.472861:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789185538.472874:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789185538.472885:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789185538.472932:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789185538.472948:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789185538.472971:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789185538.472987:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789185538.473002:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789185538.473014:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789185538.473027:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789185538.473040:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789185538.473053:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789185538.473074:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df705637 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309888:0@lo:502: 00000100:00100000:0.0:1789185538.473112:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185538.473131:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089fad80a going to sleep for 11 seconds 00000100:00100000:0.0:1789185538.473151:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898309888 00000100:00100000:0.0:1789185538.473156:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898309888 00000100:00100000:0.0:1789185538.473176:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789185538.473181:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000038922599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898309888:12345-0@lo:502: 00000100:00100000:0.0:1789185538.473256:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000038922599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898309888:12345-0@lo:502: Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185538.473262:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789185538.473298:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df705637 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898309888:0@lo:502: 00000040:00080000:0.0:1789185538.473330:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789185538.473337:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789185538.473647:0:7460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789185538.473663:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000d0edbfca) 00000020:00000080:0.0:1789185538.473684:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789185538.473760:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bf258cbf from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789185538.473764:0:7460:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bf258cbf from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789185538.473766:0:7460:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bf258cbf 3 00010000:00080000:0.0:1789185538.473793:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f3358c4b@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.148@tcp at head 00000100:00080000:3.0:1789185538.476148:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000f77843b2 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185538.476234:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d577a75b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876096898308608:12345-0@lo:38: Request processed in 18056us (18203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185538.476248:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185538.476357:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185538.476366:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789185538.476373:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789185538.476380:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789185538.476382:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000038ca6053 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789185538.476394:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c539e053 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898308608:0@lo:38: 00000100:00100000:1.0:1789185538.476573:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004acf576c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898310016:0@lo:41: 00000100:00100000:1.0:1789185538.476609:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185538.476684:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898310016 00000100:00100000:2.0:1789185538.476691:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898310016 00000100:00100000:2.0:1789185538.476719:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789185538.476725:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e299f495 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898310016:12345-0@lo:41: 00000004:00000024:2.0:1789185538.476746:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789185538.476794:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e299f495 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898310016:12345-0@lo:41: Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.476799:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185538.476993:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004acf576c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898310016:0@lo:41: 00010000:00010000:1.0:1789185538.478408:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1789185538.478642:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789185538.478693:0:7460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789185538.478705:0:7460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xda5c730d5a72a4b 00000100:00080000:1.0:1789185538.478715:0:7460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185538.478724:0:7460:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000f3358c4b using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185538.478752:0:7460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004a6eba3b x1876096898310144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789185538.478785:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789185538.479109:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a6eba3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876096898310144:0@lo:38: 00000100:00100000:0.0:1789185538.479170:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185538.479264:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898310144 00000100:00100000:3.0:1789185538.479271:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898310144 00000100:00100000:3.0:1789185538.479314:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185538.479319:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df705637 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876096898310144:12345-0@lo:38: 00010000:00080000:3.0:1789185538.479338:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1789185538.479363:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xda5c730d5a72a52 00000004:00100000:3.0:1789185538.479377:0:6513:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789185538.479402:0:6513:0:(import.c:65:import_set_state_nolock()) 0000000058c68d96 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185538.479445:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df705637 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876096898310144:12345-0@lo:38: Request processed in 125us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185538.479452:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789185538.479526:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004a6eba3b x1876096898310144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185538.479537:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789185538.479543:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789185538.479549:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789185538.479553:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789185538.479555:0:3634:0:(import.c:65:import_set_state_nolock()) 00000000f3358c4b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789185538.479559:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a6eba3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876096898310144:0@lo:38: 00000040:00080000:0.0:1789185538.479747:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1789185538.479942:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789185538.479975:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789185538.479988:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 000000003b522bee/0xda5c730d5a72a36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.479999:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 000000003b522bee/0xda5c730d5a72a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789185538.480053:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789185538.480056:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789185538.480058:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185538.480059:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185538.480061:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185538.480062:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185538.480063:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185538.480064:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789185538.480065:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789185538.480067:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185538.480068:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789185538.480072:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1789185538.480075:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789185538.480076:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789185538.480077:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185538.480082:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185538.480083:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185538.480084:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185538.480084:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185538.480085:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789185538.480086:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789185538.480087:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185538.480088:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789185538.480105:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789185538.480117:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e4852d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898310272:0@lo:253: 00000100:00100000:3.0:1789185538.480156:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185538.480181:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000004385e398 going to sleep for 11 seconds 00000100:00100000:0.0:1789185538.480276:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898310272 00000100:00100000:0.0:1789185538.480280:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898310272 00000100:00100000:0.0:1789185538.480312:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789185538.480318:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000daa4e5f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898310272:12345-0@lo:253: 20000000:01000000:0.0:1789185538.480338:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789185538.480350:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:1.0:1789185538.481180:0:7461:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:0.0:1789185538.481763:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789185538.487353:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789185538.487370:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789185538.487723:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789185538.487728:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789185538.487746:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.487774:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72972 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.487781:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a1a expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.487788:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.487821:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72a1a expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.487957:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000daa4e5f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7442:x1876096898310272:12345-0@lo:253: Request processed in 7637us (7799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.487967:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1789185538.488047:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72a1a expref: 14 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185538.488061:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898310400:0@lo:104: 00000100:00100000:3.0:1789185538.488095:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185538.488145:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72972 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.488152:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72972 expref: 14 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185538.488159:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898310528:0@lo:104: 00000100:00100000:3.0:1789185538.488176:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185538.488193:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e0c08a6 going to sleep for 11 seconds 00000100:00100000:1.0:1789185538.488238:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898310400 00000100:00100000:1.0:1789185538.488245:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898310400 00000100:00100000:1.0:1789185538.488271:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898310528 00000100:00100000:1.0:1789185538.488273:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898310528 00000100:00100000:1.0:1789185538.488283:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185538.488288:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf4a990d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6528:x1876096898310400:12345-0@lo:104: 00010000:00010000:1.0:1789185538.488299:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488345:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789185538.488350:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf4a990d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6528:x1876096898310400:12345-0@lo:104: Request processed in 62us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.488355:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185538.488366:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185538.488371:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a16f3eb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6528:x1876096898310528:12345-0@lo:104: 00010000:00010000:1.0:1789185538.488384:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488409:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789185538.488413:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a16f3eb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6528:x1876096898310528:12345-0@lo:104: Request processed in 43us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.488418:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789185538.488431:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789185538.488435:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488442:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000268e03d2 already unused, calling callback (000000005a26ab53) 10000000:00010000:1.0:1789185538.488445:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488452:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185538.488458:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185538.488463:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185538.488484:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488489:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185538.488504:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488510:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: 00000000268e03d2/0xda5c730d5a72a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a21 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488524:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185538.488526:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488532:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d75fe2d8 already unused, calling callback (000000005a26ab53) 10000000:00010000:1.0:1789185538.488533:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488538:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185538.488543:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185538.488548:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185538.488556:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488562:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185538.488565:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488570:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: 00000000d75fe2d8/0xda5c730d5a72972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72979 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488582:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185538.488584:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185538.488585:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185538.488590:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185538.488611:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c40bb0b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898310656:0@lo:103: 00000100:00100000:1.0:1789185538.488634:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185538.488651:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185538.488654:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004780f23d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898310784:0@lo:103: 00000100:00100000:1.0:1789185538.488671:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185538.488694:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898310656 00000100:00100000:1.0:1789185538.488697:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898310656 00010000:00010000:1.0:1789185538.488710:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a1a expref: 15 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.488725:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898310784 00000100:00100000:1.0:1789185538.488727:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898310784 00010000:00010000:1.0:1789185538.488733:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72972 expref: 16 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185538.488743:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185538.488747:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000752324ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3637:x1876096898310656:12345-0@lo:103: 00010000:00010000:1.0:1789185538.488755:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185538.488758:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a1a expref: 16 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488892:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72a1a expref: 16 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488929:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185538.488953:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000752324ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3637:x1876096898310656:12345-0@lo:103: Request processed in 205us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.488959:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185538.488970:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185538.488974:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d906fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:3637:x1876096898310784:12345-0@lo:103: 00010000:00010000:1.0:1789185538.488985:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185538.488989:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72972 expref: 15 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.488996:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72972 expref: 15 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.489006:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.489013:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789185538.489024:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003201916s 00010000:00010000:1.0:1789185538.489027:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.489033:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.489039:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.489044:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.489049:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c06ece8d already unused, calling callback (00000000eaa7f15e) 00010000:00010000:1.0:1789185538.489052:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.489057:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.489068:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185538.489077:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185538.489093:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d906fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:3637:x1876096898310784:12345-0@lo:103: Request processed in 120us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.489098:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185538.489147:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004780f23d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898310784:0@lo:103: 00000100:00100000:1.0:1789185538.489153:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c40bb0b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898310656:0@lo:103: 00010000:00010000:3.0:1789185538.489595:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c7f13246/0xda5c730d5a72a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72a1a expref: 14 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185538.489606:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898310400:0@lo:104: 00010000:00010000:3.0:1789185538.489613:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000588c98d5/0xda5c730d5a72979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72972 expref: 13 pid: 6506 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185538.489620:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898310528:0@lo:104: 00010000:00010000:3.0:1789185538.489634:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.489641:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.489646:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185538.489651:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185538.489754:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e4852d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:7442:1876096898310272:0@lo:253: 10000000:01000000:0.0:1789185538.489775:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789185538.489778:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789185538.489780:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789185538.489782:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185538.489783:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185538.489784:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185538.489786:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185538.489787:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789185538.489788:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789185538.489789:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789185538.489799:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185538.489800:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789185538.489810:0:7442:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789185538.497105:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1789185538.497277:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789185538.497470:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789185538.497653:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789185538.500485:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789185538.505332:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789185538.511522:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789185538.511785:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789185538.512409:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789185538.512606:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789185538.512795:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789185538.514484:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000020:00080000:3.0:1789185538.518330:0:7465:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789185538.518351:0:7465:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789185538.518367:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1789185538.518755:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1789185538.518834:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d2df130 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1876096898310912:0@lo:700: 00000100:00100000:0.0:1789185538.518903:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185538.518990:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000468e658 going to sleep for 11 seconds 00000100:00100000:1.0:1789185538.519152:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898310912 00000100:00100000:1.0:1789185538.519160:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898310912 00000100:00100000:1.0:1789185538.519214:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185538.519222:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084025a6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1876096898310912:12345-0@lo:700: 00000040:01000000:3.0:1789185538.519574:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789185538.520219:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c40bb0b8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311040:0@lo:1000: 00000100:00100000:1.0:1789185538.520264:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185538.520330:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7cfa7ed going to sleep for 11 seconds 00000040:01000000:3.0:1789185538.520721:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789185538.521125:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789185538.521577:0:7442:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789185538.521585:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789185538.521726:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:1.0:1789185538.523554:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:3.0:1789185538.527814:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1789185538.528708:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898311040 00000100:00100000:2.0:1789185538.528720:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898311040 00000100:00100000:2.0:1789185538.528793:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185538.528804:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004780f23d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311040:12345-0@lo:1000: 00000100:00100000:2.0:1789185538.529112:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004780f23d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311040:12345-0@lo:1000: Request processed in 309us (8846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.529119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185538.529211:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c40bb0b8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311040:0@lo:1000: 00000040:01000000:0.0:1789185538.529248:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1789185538.529287:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311168:0@lo:700: 00000100:00100000:0.0:1789185538.529324:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185538.529364:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf4eea54 going to sleep for 11 seconds 00000100:00100000:2.0:1789185538.529426:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898311168 00000100:00100000:2.0:1789185538.529431:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898311168 00000100:00100000:2.0:1789185538.529465:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185538.529473:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000210488dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311168:12345-0@lo:700: 00000100:00100000:2.0:1789185538.529514:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000210488dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311168:12345-0@lo:700: Request processed in 42us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185538.529527:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185538.529585:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311168:0@lo:700: 00000100:00100000:0.0:1789185538.529646:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1876096898311296:0@lo:900: 00000100:00100000:0.0:1789185538.529669:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185538.529692:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf4eea54 going to sleep for 11 seconds 00000100:00100000:2.0:1789185538.529743:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898311296 00000100:00100000:2.0:1789185538.529747:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898311296 00000100:00100000:2.0:1789185538.529782:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185538.529788:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001e7b7256 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1876096898311296:12345-0@lo:900: 00000100:00100000:2.0:1789185538.529821:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001e7b7256 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1876096898311296:12345-0@lo:900: Request processed in 34us (151us total) trans 0 rc 0/0 00010000:00080000:0.0:1789185538.529945:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f7ff7bf2 x1876096898311296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789185554 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185538.529956:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1876096898311296:0@lo:900: 00000100:00100000:0.0:1789185538.530122:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311424:0@lo:1000: 00000100:00100000:0.0:1789185538.530159:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185538.530194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898311424 00000100:00100000:0.0:1789185538.530198:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898311424 00000100:00100000:0.0:1789185538.530222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185538.530228:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a5e1c1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311424:12345-0@lo:1000: 00000100:00100000:0.0:1789185538.530312:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a5e1c1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311424:12345-0@lo:1000: Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185538.530319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185538.530334:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f66dd771 going to sleep for 11 seconds 00000100:00100000:0.0:1789185538.530345:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311424:0@lo:1000: 00000004:00080000:0.0:1789185538.530383:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000cf4eea54 with version 0 00000020:00100000:0.0:1789185538.530406:0:7467:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789185538.530411:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f7ff7bf2 x1876096898311680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185538.530423:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311680:0@lo:1000: 00000100:00100000:0.0:1789185538.530445:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185538.530463:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898311680 00000100:00100000:0.0:1789185538.530466:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898311680 00000100:00100000:0.0:1789185538.530482:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185538.530486:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c7a0333 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311680:12345-0@lo:1000: 00000100:00100000:0.0:1789185538.530936:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18a5cf8 going to sleep for 11 seconds 00000100:00100000:2.0:1789185538.531005:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1789185538.531135:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789185538.531194:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789185538.531362:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789185538.531562:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789185538.536603:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000001:00080000:0.0:1789185538.537698:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1789185538.537837:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c7a0333 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311680:12345-0@lo:1000: Request processed in 7334us (7374us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789185538.537850:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1789185538.537899:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789185538.537903:0:7467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00100000:10000000:3.0:1789185538.538484:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789185538.538800:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789185538.538996:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789185538.539150:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789185538.539356:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789185538.539486:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789185538.539615:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:1.0:1789185538.539718:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084025a6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1876096898310912:12345-0@lo:700: Request processed in 20492us (20811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.539731:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185538.540119:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311680:0@lo:1000: 00000100:00100000:0.0:1789185538.540234:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311808:0@lo:1000: 00000100:00100000:0.0:1789185538.540286:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185538.540319:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006be921b going to sleep for 11 seconds 00000100:00100000:1.0:1789185538.540398:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898311808 00000100:00100000:1.0:1789185538.540406:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898311808 00000100:00100000:1.0:1789185538.540448:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185538.540455:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000223e8936 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311808:12345-0@lo:1000: 00000100:00100000:1.0:1789185538.540531:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000223e8936 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876096898311808:12345-0@lo:1000: Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185538.540543:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185538.540575:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7ff7bf2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876096898311808:0@lo:1000: 00000040:00080000:1.0:1789185538.540591:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789185538.540617:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000ebc6d037 with version 1 00000004:00080000:0.0:1789185538.542243:0:7457:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ffdbf8c8 version 1 rpc_version 1 00000020:00100000:0.0:1789185538.542281:0:7457:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789185538.542290:0:7457:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c192c696 x1876096898312064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185538.542310:0:7457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c192c696 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1876096898312064:0@lo:1000: 00000100:00100000:0.0:1789185538.542365:0:7457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185538.542407:0:7457:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf5e869e going to sleep for 11 seconds 00100000:10000000:3.0:1789185538.542971:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789185538.543180:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789185538.543310:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789185538.543440:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789185538.543586:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789185538.543716:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789185538.549307:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789185538.549495:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789185538.549797:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00010000:00080000:2.0:1789185538.550320:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007d2df130 x1876096898310912/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789185554 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185538.550336:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d2df130 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1876096898310912:0@lo:700: 40000000:02000000:2.0:1789185538.550349:0:7466:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:1.0:1789185538.551663:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789185538.551748:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1789185538.551800:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898312064 00000100:00100000:1.0:1789185538.551808:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898312064 00000100:00100000:1.0:1789185538.551885:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185538.551893:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb348c67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7457:x1876096898312064:12345-0@lo:1000: 00100000:10000000:3.0:1789185538.554235:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789185538.554422:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000001:00080000:0.0:1789185538.556125:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789185538.556283:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb348c67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7457:x1876096898312064:12345-0@lo:1000: Request processed in 4387us (13914us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789185538.556296:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1789185538.556384:0:7457:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789185538.556389:0:7457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789185538.556407:0:7457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c192c696 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1876096898312064:0@lo:1000: 00100000:10000000:3.0:1789185538.556968:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789185538.557253:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789185538.557392:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789185538.557554:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789185538.557722:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789185538.559251:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789185538.559455:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789185538.559590:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789185538.559737:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789185538.561577:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789185538.565430:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789185538.565581:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789185538.565733:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789185538.569881:0:7442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789185538.588210:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789185538.588295:0:7442:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789185538.588332:0:7442:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb21ac19f7988 00100000:10000000:2.0:1789185538.588340:0:7442:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789185538.589107:0:7442:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789185538.589139:0:7442:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789185538.589158:0:7442:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789185538.589178:0:7442:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789185538.589971:0:7442:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185538.590164:0:7442:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1789185538.648976:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789185538.649052:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789185538.649057:0:7466:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1789185539.366086:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185540.390300:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185541.414223:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185542.442133:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185543.462453:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185543.590164:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185543.590189:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee6a5aae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898312192:0@lo:41: 00000100:00100000:2.0:1789185543.590265:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185543.590329:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898312192 00000100:00100000:2.0:1789185543.590336:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898312192 00000100:00100000:2.0:1789185543.590381:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185543.590389:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f408b57b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898312192:12345-0@lo:41: 00000004:00000024:2.0:1789185543.590441:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789185543.590488:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f408b57b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898312192:12345-0@lo:41: Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185543.590495:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185543.590538:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee6a5aae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898312192:0@lo:41: 00000100:00100000:2.0:1789185543.595445:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c27e0636 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898312448:0@lo:400: 00000100:00100000:2.0:1789185543.595520:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185543.595565:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185543.595570:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d35e071 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898312576:0@lo:400: 00000100:00100000:2.0:1789185543.595592:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185543.595946:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898312448 00000100:00100000:3.0:1789185543.595956:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898312448 00000100:00100000:3.0:1789185543.596006:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898312576 00000100:00100000:3.0:1789185543.596029:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898312576 00000100:00100000:3.0:1789185543.596051:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185543.596061:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004cab2cc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898312448:12345-0@lo:400: 00000100:00100000:3.0:1789185543.596122:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004cab2cc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898312448:12345-0@lo:400: Request processed in 63us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185543.596129:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185543.596146:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185543.596151:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000266bf3af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898312576:12345-0@lo:400: 00000100:00100000:3.0:1789185543.596176:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000266bf3af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898312576:12345-0@lo:400: Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185543.596181:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185543.596206:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185543.596216:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee6a5aae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898312320:0@lo:400: 00000100:00100000:3.0:1789185543.596249:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185543.596282:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898312320 00000100:00100000:3.0:1789185543.596286:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898312320 00000100:00100000:3.0:1789185543.596311:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789185543.596318:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ecbf28c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+13:3635:x1876096898312320:12345-0@lo:400: 00000100:00100000:3.0:1789185543.596353:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ecbf28c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+13:3635:x1876096898312320:12345-0@lo:400: Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185543.596359:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789185543.596407:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee6a5aae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898312320:0@lo:400: 00010000:00080000:3.0:1789185543.596443:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000d35e071 x1876096898312576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185543.596456:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d35e071 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898312576:0@lo:400: 00010000:00080000:3.0:1789185543.596469:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c27e0636 x1876096898312448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185543.596487:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c27e0636 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898312448:0@lo:400: 00000001:02000400:3.0:1789185544.225677:0:7711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789185544.488004:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789185545.128117:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789185545.128126:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f30030e800 from 4 10000000:01000000:1.0:1789185545.128131:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789185545.128178:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000f4f72f24/0xda5c730d5a72a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185545.128191:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000f4f72f24/0xda5c730d5a72a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185545.128203:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000f4f72f24/0xda5c730d5a72a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185545.128228:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000752324ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898312704:0@lo:101: 00000100:00100000:1.0:1789185545.128309:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185545.128363:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e2661d1 going to sleep for 11 seconds 00000100:00100000:0.0:1789185545.128507:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898312704 00000100:00100000:0.0:1789185545.128518:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898312704 00000100:00100000:0.0:1789185545.128577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789185545.128585:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008cc1eec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+13:6509:x1876096898312704:12345-0@lo:101: 00010000:00010000:0.0:1789185545.128598:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185545.128611:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099763dd5/0xda5c730d5a72a67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72a60 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185545.128634:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099763dd5/0xda5c730d5a72a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72a60 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185545.128644:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099763dd5/0xda5c730d5a72a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a60 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185545.128659:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099763dd5, rc 0) 00000100:00100000:0.0:1789185545.128718:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008cc1eec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+14:6509:x1876096898312704:12345-0@lo:101: Request processed in 133us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185545.128724:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789185545.128936:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000752324ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898312704:0@lo:101: 00010000:00010000:1.0:1789185545.129197:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000f4f72f24/0xda5c730d5a72a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185545.129206:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000f4f72f24/0xda5c730d5a72a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185545.129259:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000752324ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898312832:0@lo:256: 00000100:00100000:1.0:1789185545.129292:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185545.129359:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e2661d1 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.138119:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898312832 00000100:00100000:3.0:1789185545.138138:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898312832 00000100:00100000:3.0:1789185545.138210:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789185545.138218:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000956ad62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:6509:x1876096898312832:12345-0@lo:256: 20000000:01000000:3.0:1789185545.138248:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789185545.138276:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789185545.138279:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789185545.138434:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000956ad62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:6509:x1876096898312832:12345-0@lo:256: Request processed in 217us (9142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.138442:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789185545.140447:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000752324ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898312832:0@lo:256: 10000000:01000000:2.0:1789185545.140516:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789185545.140524:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000f4f72f24/0xda5c730d5a72a60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185545.140535:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000f4f72f24/0xda5c730d5a72a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185545.140547:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789185545.140549:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2e7ae1000 from 21 10000000:01000000:2.0:1789185545.140552:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789185545.140596:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a72a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185545.140604:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a72a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185545.140612:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a72a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185545.140639:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c27e0636 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898312960:0@lo:101: 00000100:00100000:2.0:1789185545.140693:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185545.140750:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1cd8044 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.143501:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898312960 00000100:00100000:3.0:1789185545.143513:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898312960 00000100:00100000:3.0:1789185545.143661:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789185545.143670:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e697cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+14:6509:x1876096898312960:12345-0@lo:101: 00010000:00010000:3.0:1789185545.143690:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185545.143726:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72a6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.143753:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72a6e expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.143763:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c06ece8d/0xda5c730d5a72a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a6e expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.143771:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c06ece8d, rc 0) 00000100:00100000:3.0:1789185545.143846:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e697cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898312960:12345-0@lo:101: Request processed in 177us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.143852:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789185545.143900:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c27e0636 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898312960:0@lo:101: 00010000:00010000:3.0:1789185545.143931:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a72a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.143940:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a72a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185545.144020:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313088:0@lo:501: 00000100:00100000:3.0:1789185545.144063:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.144093:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000007194f592 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.144117:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898313088 00000100:00100000:3.0:1789185545.144120:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898313088 00000100:00100000:3.0:1789185545.144140:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789185545.144144:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bbecd3f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898313088:12345-0@lo:501: 00000100:00100000:3.0:1789185545.144252:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bbecd3f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898313088:12345-0@lo:501: Request processed in 106us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.144259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789185545.144285:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313088:0@lo:501: 00000100:00100000:3.0:1789185545.144319:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313216:0@lo:503: 00000100:00100000:3.0:1789185545.144355:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.144366:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000007194f592 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.144377:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898313216 00000100:00100000:3.0:1789185545.144379:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898313216 00000100:00100000:3.0:1789185545.144398:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185545.144409:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf73549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898313216:12345-0@lo:503: 00000100:00100000:3.0:1789185545.144477:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf73549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898313216:12345-0@lo:503: Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.144483:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185545.144516:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313216:0@lo:503: 00000100:00100000:3.0:1789185545.144662:0:7752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:7752:1876096898313344:0@lo:502: 00000100:00100000:3.0:1789185545.144688:0:7752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.144713:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898313344 00000100:00100000:3.0:1789185545.144717:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898313344 00000100:00100000:3.0:1789185545.144733:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789185545.144737:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fce35324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7752:x1876096898313344:12345-0@lo:502: 00000100:00100000:3.0:1789185545.144798:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fce35324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7752:x1876096898313344:12345-0@lo:502: Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.144804:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789185545.144825:0:7752:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5d98a5 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.144834:0:7752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:7752:1876096898313344:0@lo:502: 00000100:00100000:3.0:1789185545.144864:0:7752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:7752:1876096898313472:0@lo:502: 00000100:00100000:3.0:1789185545.144889:0:7752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.144902:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898313472 00000100:00100000:3.0:1789185545.144905:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898313472 00000100:00100000:3.0:1789185545.144950:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185545.144954:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad7e19cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7752:x1876096898313472:12345-0@lo:502: 00000100:00100000:3.0:1789185545.144997:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad7e19cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:7752:x1876096898313472:12345-0@lo:502: Request processed in 43us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.145002:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185545.145032:0:7752:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5d98a5 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.145040:0:7752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:7752:1876096898313472:0@lo:502: 00000040:00080000:3.0:1789185545.145054:0:7752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789185545.145097:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789185545.145113:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789185545.145118:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a72a6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145127:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000a09bc03f/0xda5c730d5a72a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185545.145135:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789185545.145137:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f2e7ae1000 from 4 10000000:01000000:3.0:1789185545.145139:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185545.145156:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 00000000588c98d5/0xda5c730d5a72a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145163:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 00000000588c98d5/0xda5c730d5a72a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145170:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 00000000588c98d5/0xda5c730d5a72a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185545.145180:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313600:0@lo:101: 00000100:00100000:3.0:1789185545.145201:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.145214:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5d98a5 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.145224:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898313600 00000100:00100000:3.0:1789185545.145227:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898313600 00000100:00100000:3.0:1789185545.145245:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789185545.145250:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6804eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898313600:12345-0@lo:101: 00010000:00010000:3.0:1789185545.145262:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185545.145271:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab99809d/0xda5c730d5a72a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72a7c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145288:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab99809d/0xda5c730d5a72a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72a7c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145295:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab99809d/0xda5c730d5a72a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a7c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145301:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab99809d, rc 0) 00000100:00100000:3.0:1789185545.145326:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6804eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898313600:12345-0@lo:101: Request processed in 76us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.145331:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789185545.145359:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313600:0@lo:101: 00010000:00010000:3.0:1789185545.145369:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 00000000588c98d5/0xda5c730d5a72a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145376:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 00000000588c98d5/0xda5c730d5a72a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185545.145414:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313728:0@lo:256: 00000100:00100000:3.0:1789185545.145442:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.145454:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5d98a5 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.145464:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898313728 00000100:00100000:3.0:1789185545.145467:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898313728 00000100:00100000:3.0:1789185545.145483:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789185545.145487:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002060e80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898313728:12345-0@lo:256: 20000000:01000000:3.0:1789185545.145504:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789185545.145519:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789185545.145521:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789185545.145578:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002060e80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898313728:12345-0@lo:256: Request processed in 91us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.145584:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789185545.145605:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313728:0@lo:256: 10000000:01000000:3.0:1789185545.145640:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789185545.145644:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 00000000588c98d5/0xda5c730d5a72a7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145650:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 00000000588c98d5/0xda5c730d5a72a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185545.145656:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789185545.145658:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789185545.145660:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789185545.145671:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145677:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145684:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185545.145694:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313856:0@lo:101: 00000100:00100000:3.0:1789185545.145748:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.145759:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5d98a5 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.145774:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898313856 00000100:00100000:3.0:1789185545.145778:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898313856 00000100:00100000:3.0:1789185545.145797:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789185545.145802:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000535d79e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898313856:12345-0@lo:101: 00010000:00010000:3.0:1789185545.145808:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185545.145814:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c77712f8/0xda5c730d5a72a91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72a8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145826:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c77712f8/0xda5c730d5a72a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72a8a expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145832:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c77712f8/0xda5c730d5a72a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a8a expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145838:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c77712f8, rc 0) 00000100:00100000:3.0:1789185545.145862:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000535d79e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898313856:12345-0@lo:101: Request processed in 60us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.145866:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789185545.145890:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313856:0@lo:101: 00010000:00010000:3.0:1789185545.145898:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72a8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.145905:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72a8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185545.145972:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313984:0@lo:501: 00000100:00100000:3.0:1789185545.145992:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.146010:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5d98a5 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.146018:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898313984 00000100:00100000:3.0:1789185545.146026:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898313984 00000100:00100000:3.0:1789185545.146044:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789185545.146048:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c158454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898313984:12345-0@lo:501: 00000100:00100000:3.0:1789185545.146121:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c158454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898313984:12345-0@lo:501: Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.146127:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789185545.146151:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898313984:0@lo:501: 00000100:00100000:3.0:1789185545.146172:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898314112:0@lo:503: 00000100:00100000:3.0:1789185545.146203:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.146214:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5d98a5 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.146225:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898314112 00000100:00100000:3.0:1789185545.146228:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898314112 00000100:00100000:3.0:1789185545.155278:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789185545.155296:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e639b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898314112:12345-0@lo:503: 00000100:00100000:3.0:1789185545.155468:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e639b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898314112:12345-0@lo:503: Request processed in 179us (9265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.155477:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789185545.157468:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898314112:0@lo:503: 00000100:00100000:0.0:1789185545.160388:0:7754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c192c696 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:7754:1876096898314240:0@lo:502: 00000100:00100000:0.0:1789185545.160472:0:7754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185545.160569:0:7754:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3da66ba going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.160894:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898314240 00000100:00100000:3.0:1789185545.160903:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898314240 00000100:00100000:3.0:1789185545.160974:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789185545.160983:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000032758955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:7754:x1876096898314240:12345-0@lo:502: 00000100:00100000:3.0:1789185545.161123:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000032758955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:7754:x1876096898314240:12345-0@lo:502: Request processed in 141us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.161132:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789185545.161210:0:7754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c192c696 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:7754:1876096898314240:0@lo:502: 00000020:01000000:2.0:1789185545.161239:0:7754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185545.161251:0:7754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185545.161253:0:7754:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789185545.161258:0:7754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789185545.161262:0:7754:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:00000080:2.0:1789185545.161286:0:7754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185545.161303:0:7754:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000009139966) 00000020:00000080:2.0:1789185545.161325:0:7754:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1789185545.161331:0:7754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789185545.161422:0:7754:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789185545.161428:0:7754:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789185545.161437:0:7754:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a72a9f 00010000:00080000:2.0:1789185545.161466:0:7754:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d70aad43@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.148@tcp at head 00010000:00010000:1.0:1789185545.166305:0:7754:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789185545.179287:0:7754:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789185545.179373:0:7754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789185545.179418:0:7754:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789185545.179442:0:7754:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a72aa6 00000100:00080000:0.0:1789185545.179453:0:7754:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789185545.179464:0:7754:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d70aad43 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185545.179501:0:7754:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000539e54bc x1876096898314368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185545.179532:0:7754:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1789185545.179572:0:7754:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789185545.179802:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000539e54bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898314368:0@lo:38: 00000100:00100000:2.0:1789185545.179874:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185545.179957:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898314368 00000100:00100000:2.0:1789185545.179964:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898314368 00000100:00100000:2.0:1789185545.179996:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185545.180003:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d35e071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898314368:12345-0@lo:38: 00010000:00080000:2.0:1789185545.180030:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1789185545.180064:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a72aad 00000004:00100000:2.0:1789185545.180078:0:6517:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789185545.180083:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789185545.180364:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000369243db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898314624:0@lo:400: 00000100:00100000:3.0:1789185545.180401:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.180425:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185545.180430:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898314496:0@lo:400: 00000100:00100000:3.0:1789185545.180453:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.180475:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898314752:0@lo:400: 00000100:00100000:3.0:1789185545.180496:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.180523:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898314496 00000100:00100000:3.0:1789185545.180528:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898314496 00000100:00100000:3.0:1789185545.180558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898314752 00000100:00100000:3.0:1789185545.180561:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898314752 00000100:00100000:3.0:1789185545.180575:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185545.180581:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae19d08f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898314496:12345-0@lo:400: 00000100:00100000:3.0:1789185545.180625:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae19d08f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898314496:12345-0@lo:400: Request processed in 45us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.180633:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185545.180663:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789185545.180669:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c539e053 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898314752:12345-0@lo:400: 00000100:00100000:3.0:1789185545.180710:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c539e053 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898314752:12345-0@lo:400: Request processed in 28us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.180715:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185545.180967:0:6518:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789185545.180976:0:6518:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:3.0:1789185545.181268:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004c0acff5 x1876096898314752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185545.181284:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0acff5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898314752:0@lo:400: 00010000:00080000:3.0:1789185545.181466:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000016b647c4 x1876096898314496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185545.181476:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898314496:0@lo:400: 00000020:01000000:3.0:1789185545.181808:0:7754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185545.181822:0:7754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185545.181824:0:7754:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789185545.181828:0:7754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185545.181832:0:7754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185545.181834:0:7754:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789185545.181837:0:7754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789185545.181839:0:7754:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789185545.181868:0:7754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:7754:1876096898314880:0@lo:502: 00000100:00100000:3.0:1789185545.181938:0:7754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.181967:0:7754:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053240ffa going to sleep for 11 seconds 00000100:00100000:2.0:1789185545.182404:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898314624 00000100:00100000:2.0:1789185545.182411:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898314624 00000100:00100000:2.0:1789185545.182448:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898314880 00000100:00100000:2.0:1789185545.182450:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898314880 00000100:00100000:2.0:1789185545.182473:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789185545.182479:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071ad2924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:7754:x1876096898314880:12345-0@lo:502: 00000100:00100000:2.0:1789185545.182598:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071ad2924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:7754:x1876096898314880:12345-0@lo:502: Request processed in 119us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185545.182605:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789185545.182816:0:7758:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000ee6a5aae x1876096898315008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185545.182826:0:7758:0:(client.c:2716:ptlrpc_set_wait()) set 0000000004333ca1 going to sleep for 0 seconds 00000100:00100000:3.0:1789185545.182887:0:7754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:7754:1876096898314880:0@lo:502: 00000100:00100000:2.0:1789185545.183067:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789185545.183076:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e4852d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898314624:12345-0@lo:400: 00000100:00100000:2.0:1789185545.183122:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e4852d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898314624:12345-0@lo:400: Request processed in 49us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185545.183129:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:3.0:1789185545.183263:0:7754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185545.183269:0:7754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185545.183270:0:7754:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789185545.183274:0:7754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1789185545.183478:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000369243db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898314624:0@lo:400: 00000020:01000000:2.0:1789185545.183536:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789185545.183556:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789185545.183565:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72a8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185545.183577:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 000000000dee6d62/0xda5c730d5a72a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185545.183588:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789185545.183590:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98f2c6fd4d40 from 1 10000000:01000000:2.0:1789185545.183599:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789185545.183624:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72ab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185545.183632:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72ab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185545.183640:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72ab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185545.183803:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf734bb7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898315136:0@lo:101: 00000100:00100000:2.0:1789185545.183843:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185545.183884:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc716da8 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.183950:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898315136 00000100:00100000:3.0:1789185545.183956:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898315136 00000100:00100000:3.0:1789185545.183989:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789185545.183995:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c594ef76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898315136:12345-0@lo:101: 00010000:00010000:3.0:1789185545.184004:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185545.184015:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8993b73/0xda5c730d5a72abb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72ab4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.184038:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8993b73/0xda5c730d5a72abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72ab4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.184047:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8993b73/0xda5c730d5a72abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ab4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185545.184065:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8993b73, rc 0) 00000100:00100000:3.0:1789185545.184101:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c594ef76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898315136:12345-0@lo:101: Request processed in 107us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.184107:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789185545.184532:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf734bb7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898315136:0@lo:101: 00010000:00010000:0.0:1789185545.184550:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72ab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185545.184561:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72ab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185545.184633:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e68f376 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898315264:0@lo:501: 00000100:00100000:0.0:1789185545.184675:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185545.184719:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee105748 going to sleep for 11 seconds 00000100:00100000:2.0:1789185545.184742:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898315264 00000100:00100000:2.0:1789185545.184748:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898315264 00000100:00100000:2.0:1789185545.184780:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789185545.184787:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c75e0a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898315264:12345-0@lo:501: 00000100:00100000:2.0:1789185545.184874:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c75e0a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898315264:12345-0@lo:501: Request processed in 88us (199us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185545.184882:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789185545.188031:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e68f376 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898315264:0@lo:501: 10000000:01000000:0.0:1789185545.188088:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789185545.188098:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72ab4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185545.188123:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: 000000003601d35d/0xda5c730d5a72ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789185545.199419:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000e20bb365 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185545.199588:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d35e071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1876096898314368:12345-0@lo:38: Request processed in 19582us (19713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.199599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185545.199820:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789185545.199830:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789185545.199838:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789185545.199843:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789185545.199845:0:3634:0:(import.c:65:import_set_state_nolock()) 00000000d70aad43 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789185545.199895:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000004333ca1): req@00000000ee6a5aae x1876096898315008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185545.199946:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000539e54bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898314368:0@lo:38: 00000100:00100000:3.0:1789185545.200243:0:7758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.200277:0:7758:0:(client.c:2716:ptlrpc_set_wait()) set 0000000004333ca1 going to sleep for 11 seconds 00000100:00100000:2.0:1789185545.200586:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898315008 00000100:00100000:2.0:1789185545.200594:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898315008 00000100:00100000:2.0:1789185545.200650:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789185545.200660:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000369243db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7758:x1876096898315008:12345-0@lo:1000: 00000100:00100000:2.0:1789185545.200763:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000369243db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7758:x1876096898315008:12345-0@lo:1000: Request processed in 105us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185545.200771:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185545.201840:0:7758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee6a5aae pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898315008:0@lo:1000: 00000040:01000000:3.0:1789185545.201877:0:7758:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789185545.201931:0:7758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898315392:0@lo:1000: 00000100:00100000:3.0:1789185545.202186:0:7758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.202229:0:7758:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5d98a5 going to sleep for 11 seconds 00000100:00100000:2.0:1789185545.202392:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898315392 00000100:00100000:2.0:1789185545.202397:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898315392 00000100:00100000:2.0:1789185545.202439:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789185545.202446:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c0acff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7758:x1876096898315392:12345-0@lo:1000: 00000100:00100000:2.0:1789185545.202833:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c0acff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7758:x1876096898315392:12345-0@lo:1000: Request processed in 387us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185545.202841:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185545.203080:0:7758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898315392:0@lo:1000: 00000100:00100000:3.0:1789185545.203205:0:7758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898315520:0@lo:700: 00000100:00100000:3.0:1789185545.203235:0:7758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.203264:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898315520 00000100:00100000:3.0:1789185545.203268:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898315520 00000100:00100000:3.0:1789185545.203294:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185545.203300:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000697ff2bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7758:x1876096898315520:12345-0@lo:700: 00000100:00100000:3.0:1789185545.203557:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000697ff2bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7758:x1876096898315520:12345-0@lo:700: Request processed in 187us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185545.203565:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185545.203593:0:7758:0:(client.c:2716:ptlrpc_set_wait()) set 000000007194f592 going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.203607:0:7758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898315520:0@lo:700: 00000100:00100000:3.0:1789185545.208875:0:7758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898315648:0@lo:1000: 00000100:00100000:3.0:1789185545.208970:0:7758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.209002:0:7758:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1cd8044 going to sleep for 11 seconds 00000100:00100000:0.0:1789185545.209047:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898315648 00000100:00100000:0.0:1789185545.209057:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898315648 00000100:00100000:0.0:1789185545.209127:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789185545.209136:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006eda2020 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7758:x1876096898315648:12345-0@lo:1000: 00000100:00100000:0.0:1789185545.209250:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006eda2020 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7758:x1876096898315648:12345-0@lo:1000: Request processed in 115us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185545.209259:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185545.210919:0:7758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898315648:0@lo:1000: 00000004:00080000:3.0:1789185545.211000:0:7758:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000007194f592 with version 0 00000020:00100000:3.0:1789185545.211022:0:7758:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789185545.211029:0:7758:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000016b647c4 x1876096898315904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789185545.211046:0:7758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898315904:0@lo:1000: 00000100:00100000:3.0:1789185545.211098:0:7758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185545.214351:0:7758:0:(client.c:2716:ptlrpc_set_wait()) set 000000003598401e going to sleep for 11 seconds 00000100:00100000:3.0:1789185545.214392:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898315904 00000100:00100000:3.0:1789185545.214401:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898315904 00000100:00100000:3.0:1789185545.214462:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185545.214471:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004cae2968 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7758:x1876096898315904:12345-0@lo:1000: 00000100:00100000:2.0:1789185545.222612:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e68f376 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898316032:0@lo:41: 00000100:00100000:2.0:1789185545.223231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185545.223451:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898316032 00000100:00100000:0.0:1789185545.223460:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898316032 00000100:00100000:0.0:1789185545.223508:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789185545.223514:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ab55337 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3638:x1876096898316032:12345-0@lo:41: 00000004:00000024:0.0:1789185545.223547:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789185545.223592:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ab55337 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3638:x1876096898316032:12345-0@lo:41: Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185545.223597:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789185545.223746:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e68f376 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898316032:0@lo:41: 00000001:00080000:2.0:1789185545.229374:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1789185545.229393:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:2.0:1789185545.229723:0:7758:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789185545.229728:0:7758:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789185545.229744:0:7758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016b647c4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898315904:0@lo:1000: 00000100:00100000:2.0:1789185545.229847:0:7758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000085d048c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898316160:0@lo:1000: 00000100:00100000:2.0:1789185545.229888:0:7758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185545.229947:0:7758:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c34495e going to sleep for 11 seconds 00000100:00100000:0.0:1789185545.230755:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004cae2968 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7758:x1876096898315904:12345-0@lo:1000: Request processed in 15163us (18534us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789185545.230783:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789185545.230818:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898316160 00000100:00100000:0.0:1789185545.230825:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898316160 00000100:00100000:0.0:1789185545.230874:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789185545.230882:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ecf2437e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7758:x1876096898316160:12345-0@lo:1000: 00000100:00100000:0.0:1789185545.230986:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ecf2437e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7758:x1876096898316160:12345-0@lo:1000: Request processed in 106us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185545.230992:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789185545.232116:0:7758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000085d048c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7758:1876096898316160:0@lo:1000: 00000040:00080000:2.0:1789185545.232164:0:7758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789185545.232204:0:7758:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b14ce777 with version 1 00000004:00080000:1.0:1789185545.233550:0:7755:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000005d92923c version 1 rpc_version 1 00000020:00100000:1.0:1789185545.233594:0:7755:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789185545.233604:0:7755:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007c0692dc x1876096898316416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185545.233626:0:7755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c0692dc pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7755:1876096898316416:0@lo:1000: 00000100:00100000:1.0:1789185545.233710:0:7755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185545.233752:0:7755:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb6f4a4e going to sleep for 11 seconds 00000100:00100000:1.0:1789185545.233773:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898316416 00000100:00100000:1.0:1789185545.233779:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898316416 00000100:00100000:1.0:1789185545.233821:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185545.233828:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000588952b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7755:x1876096898316416:12345-0@lo:1000: 00000040:00080000:2.0:1789185545.236495:0:7758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789185545.236576:0:7758:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789185545.236581:0:7758:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1789185545.240056:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789185545.240216:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000588952b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7755:x1876096898316416:12345-0@lo:1000: Request processed in 6385us (6502us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789185545.240231:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1789185545.240817:0:7755:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789185545.240834:0:7755:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789185545.240852:0:7755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c0692dc pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7755:1876096898316416:0@lo:1000: 00000020:00000004:2.0:1789185545.320065:0:7770:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185545.320806:0:7770:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789185545.510618:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185546.534465:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185547.562358:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789185548.446647:0:7871:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185548.446867:0:7871:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789185548.584559:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185548.711521:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185548.711553:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000085d048c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898316544:0@lo:41: 00000100:00100000:0.0:1789185548.711651:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185548.711751:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898316544 00000100:00100000:2.0:1789185548.711762:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898316544 00000100:00100000:2.0:1789185548.711828:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789185548.711837:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000539978c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898316544:12345-0@lo:41: 00000004:00000024:2.0:1789185548.711871:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789185548.718834:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000539978c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898316544:12345-0@lo:41: Request processed in 6986us (7171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185548.718852:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789185548.718905:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000085d048c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898316544:0@lo:41: 00010000:00010000:2.0:1789185549.613594:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789185549.660816:0:7919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd405ff6c0 20000000:00000080:1.0:1789185549.660833:0:7919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f300e8e800 uarg=0000000000000000 20000000:01000000:1.0:1789185549.660881:0:7919:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789185549.660888:0:7919:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789185549.660893:0:7919:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789185549.660994:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789185549.661006:0:7919:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789185549.669743:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185549.671141:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789185549.671187:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789185549.671205:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789185549.671222:0:7919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789185549.671241:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185549.671260:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7293a expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185549.671266:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a28 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185549.671272:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185549.671659:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72a28 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185549.671690:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72a28 expref: 17 pid: 6507 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185549.671707:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c0692dc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876096898316672:0@lo:104: 00000100:00100000:1.0:1789185549.671779:0:7919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185549.671848:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a7293a expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185549.671855:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a7293a expref: 17 pid: 6505 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185549.671863:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e6ad23ab pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876096898316800:0@lo:104: 00000100:00100000:1.0:1789185549.671881:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e3b3436 going to sleep for 11 seconds 00000100:00100000:2.0:1789185549.671955:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789185549.671976:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185549.672003:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898316672 00000100:00100000:2.0:1789185549.672010:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898316672 00000100:00100000:2.0:1789185549.672044:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898316800 00000100:00100000:2.0:1789185549.672047:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898316800 00000100:00100000:2.0:1789185549.672060:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185549.672066:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007abc018 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:7919:x1876096898316672:12345-0@lo:104: 00010000:00010000:2.0:1789185549.672078:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672159:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185549.672164:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007abc018 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:7919:x1876096898316672:12345-0@lo:104: Request processed in 99us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185549.672172:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185549.672208:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185549.672213:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004acf576c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:7919:x1876096898316800:12345-0@lo:104: 00010000:00010000:2.0:1789185549.672220:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672250:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789185549.672254:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004acf576c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:7919:x1876096898316800:12345-0@lo:104: Request processed in 42us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185549.672258:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789185549.672273:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185549.672277:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672284:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000977a2020 already unused, calling callback (000000005a26ab53) 10000000:00010000:2.0:1789185549.672287:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672294:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185549.672300:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185549.672306:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789185549.672341:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672347:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185549.672367:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672373:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: 00000000977a2020/0xda5c730d5a72a28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a2f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672386:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185549.672388:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672393:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000096101774 already unused, calling callback (000000005a26ab53) 10000000:00010000:2.0:1789185549.672395:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672401:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185549.672405:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185549.672410:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789185549.672422:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672427:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185549.672439:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672454:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: 0000000096101774/0xda5c730d5a7293a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72941 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672466:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185549.672468:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185549.672469:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185549.672475:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185549.672493:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d974144c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898316928:0@lo:103: 00000100:00100000:2.0:1789185549.672523:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185549.672566:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185549.672573:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898317056:0@lo:103: 00000100:00100000:2.0:1789185549.672595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185549.672702:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898316928 00000100:00100000:2.0:1789185549.672707:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898316928 00010000:00010000:2.0:1789185549.672725:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a28 expref: 18 pid: 6507 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185549.672745:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898317056 00000100:00100000:2.0:1789185549.672748:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898317056 00010000:00010000:2.0:1789185549.672759:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7293a expref: 19 pid: 6505 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185549.672772:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185549.672777:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c951004d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3636:x1876096898316928:12345-0@lo:103: 00010000:00010000:2.0:1789185549.672787:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185549.672791:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a28 expref: 19 pid: 6507 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672812:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72a28 expref: 19 pid: 6507 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672826:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185549.672853:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c951004d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3636:x1876096898316928:12345-0@lo:103: Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185549.672860:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185549.672874:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185549.672879:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7ccb2f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3638:x1876096898317056:12345-0@lo:103: 00010000:00010000:2.0:1789185549.672887:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185549.672890:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7293a expref: 18 pid: 6505 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672897:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a7293a expref: 18 pid: 6505 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672928:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672935:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672948:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672954:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672959:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672971:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672976:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d75fe2d8 already unused, calling callback (00000000eaa7f15e) 00010000:00010000:2.0:1789185549.672979:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672985:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.672993:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185549.673001:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185549.673028:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7ccb2f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3638:x1876096898317056:12345-0@lo:103: Request processed in 149us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185549.673034:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185549.673146:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6761a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898317056:0@lo:103: 00000100:00100000:2.0:1789185549.673169:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d974144c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898316928:0@lo:103: 00010000:00010000:1.0:1789185549.675261:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee28432d/0xda5c730d5a72a2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72a28 expref: 17 pid: 6507 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185549.675297:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c0692dc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876096898316672:0@lo:104: 00010000:00010000:1.0:1789185549.675310:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000900cfb1b/0xda5c730d5a72941 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a7293a expref: 16 pid: 6505 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185549.675319:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e6ad23ab pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876096898316800:0@lo:104: 00010000:00010000:1.0:1789185549.675341:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185549.675350:0:7919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185549.675356:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185549.675379:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d75fe2d8/0xda5c730d5a72ac2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185550.246237:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c0692dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898317440:0@lo:400: 00000100:00100000:2.0:1789185550.246286:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e6ad23ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898317184:0@lo:400: 00000100:00100000:2.0:1789185550.246323:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185550.246323:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185550.246377:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185550.246383:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c671e36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898317568:0@lo:400: 00000100:00100000:1.0:1789185550.246387:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898317184 00000100:00100000:1.0:1789185550.246396:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898317184 00000100:00100000:0.0:1789185550.246406:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185550.246438:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185550.246446:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f537b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3638:x1876096898317184:12345-0@lo:400: 00000100:00100000:0.0:1789185550.246453:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898317440 00000100:00100000:0.0:1789185550.246456:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898317440 00000100:00100000:0.0:1789185550.246479:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789185550.246483:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e68f376 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898317440:12345-0@lo:400: 00000100:00100000:1.0:1789185550.246489:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f537b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3638:x1876096898317184:12345-0@lo:400: Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185550.246494:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789185550.246513:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e68f376 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898317440:12345-0@lo:400: Request processed in 30us (192us total) trans 0 rc 0/0 00010000:00080000:1.0:1789185550.246556:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007c0692dc x1876096898317440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185550.246569:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c0692dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898317440:0@lo:400: 00000100:00100000:1.0:1789185550.246620:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898317568 00000100:00100000:1.0:1789185550.246623:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898317568 00000100:00100000:1.0:1789185550.246648:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185550.246653:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000539e54bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898317568:12345-0@lo:400: 00000100:00100000:1.0:1789185550.246699:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000539e54bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898317568:12345-0@lo:400: Request processed in 47us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185550.246704:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185550.246728:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c671e36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898317568:0@lo:400: 00000100:00100000:0.0:1789185550.246763:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185550.247090:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3e3576b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898317696:0@lo:400: 00000100:00100000:3.0:1789185550.247120:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185550.247165:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898317696 00000100:00100000:3.0:1789185550.247169:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898317696 00000100:00100000:3.0:1789185550.247200:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185550.247207:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fed5e21f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898317696:12345-0@lo:400: 00000100:00100000:3.0:1789185550.247240:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fed5e21f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898317696:12345-0@lo:400: Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185550.247246:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789185550.247279:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d3e3576b x1876096898317696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185550.247288:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3e3576b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898317696:0@lo:400: 00000100:00100000:2.0:1789185550.251669:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e6ad23ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898317184:0@lo:400: 00000100:00100000:2.0:1789185550.251685:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d9dd0b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898317312:0@lo:41: 00000100:00100000:2.0:1789185550.251742:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185550.251779:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034b5e73a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898317824:0@lo:400: 00000100:00100000:2.0:1789185550.251799:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185550.251927:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898317312 00000100:00100000:1.0:1789185550.251934:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898317312 00000100:00100000:1.0:1789185550.251987:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898317824 00000100:00100000:1.0:1789185550.251991:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898317824 00000100:00100000:1.0:1789185550.252006:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789185550.252019:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d974144c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898317312:12345-0@lo:41: 00000004:00000024:1.0:1789185550.252061:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789185550.252104:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d974144c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898317312:12345-0@lo:41: Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185550.252111:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789185550.252126:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789185550.252132:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c6761a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898317824:12345-0@lo:400: 00000100:00100000:1.0:1789185550.252157:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c6761a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898317824:12345-0@lo:400: Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185550.252164:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185550.253376:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d9dd0b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898317312:0@lo:41: 00000100:00100000:2.0:1789185550.253390:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034b5e73a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898317824:0@lo:400: 00010000:00010000:3.0:1789185550.632682:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185551.654331:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185552.678227:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185553.712792:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185553.830121:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185553.831740:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c192c696 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898317952:0@lo:41: 00000100:00100000:3.0:1789185553.831854:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185553.832038:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898317952 00000100:00100000:1.0:1789185553.832052:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898317952 00000100:00100000:1.0:1789185553.832121:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789185553.832131:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f55276d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898317952:12345-0@lo:41: 00000004:00000024:1.0:1789185553.832184:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789185553.832265:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f55276d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898317952:12345-0@lo:41: Request processed in 136us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185553.832273:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185553.833732:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c192c696 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898317952:0@lo:41: 10000000:01000000:2.0:1789185554.346178:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185554.346199:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f30030e800 from 1 10000000:01000000:2.0:1789185554.346206:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185554.346277:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: 0000000073d14847/0xda5c730d5a72ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185554.346295:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: 0000000073d14847/0xda5c730d5a72ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185554.346322:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: 0000000073d14847/0xda5c730d5a72ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185554.346353:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318080:0@lo:101: 00000100:00100000:2.0:1789185554.346450:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185554.346543:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000005933b5bd going to sleep for 11 seconds 00000100:00100000:1.0:1789185554.346754:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898318080 00000100:00100000:1.0:1789185554.346765:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898318080 00000100:00100000:1.0:1789185554.346843:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789185554.346854:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e2cca87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898318080:12345-0@lo:101: 00010000:00010000:1.0:1789185554.346875:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185554.346894:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7f13246/0xda5c730d5a72ad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72ac9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185554.346952:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7f13246/0xda5c730d5a72ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72ac9 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185554.346983:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7f13246/0xda5c730d5a72ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ac9 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185554.346995:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7f13246, rc 0) 00000100:00100000:1.0:1789185554.347061:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e2cca87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898318080:12345-0@lo:101: Request processed in 208us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185554.347068:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789185554.347132:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073df77a6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318080:0@lo:101: 00010000:00010000:1.0:1789185554.347151:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: 0000000073d14847/0xda5c730d5a72ac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185554.347160:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: 0000000073d14847/0xda5c730d5a72ac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185554.347245:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c671e36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318208:0@lo:501: 00000100:00100000:1.0:1789185554.347273:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185554.347290:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072e1bf96 going to sleep for 11 seconds 00000100:00100000:0.0:1789185554.348072:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898318208 00000100:00100000:0.0:1789185554.348082:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898318208 00000100:00100000:0.0:1789185554.348131:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789185554.348140:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000880a8c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898318208:12345-0@lo:501: 00000100:00100000:0.0:1789185554.348354:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000880a8c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898318208:12345-0@lo:501: Request processed in 215us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185554.348364:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789185554.348752:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c671e36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318208:0@lo:501: 00000100:00100000:1.0:1789185554.348803:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c671e36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318336:0@lo:503: 00000100:00100000:1.0:1789185554.348877:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185554.348943:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072e1bf96 going to sleep for 11 seconds 00000100:00100000:1.0:1789185554.348959:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898318336 00000100:00100000:1.0:1789185554.348963:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898318336 00000100:00100000:1.0:1789185554.348990:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789185554.348996:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ad953c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898318336:12345-0@lo:503: 00000100:00100000:1.0:1789185554.349094:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ad953c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898318336:12345-0@lo:503: Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185554.349109:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789185554.349152:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c671e36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318336:0@lo:503: 00000100:00100000:1.0:1789185554.349763:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c671e36 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8099:1876096898318464:0@lo:502: 00000100:00100000:1.0:1789185554.349810:0:8099:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185554.349900:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898318464 00000100:00100000:1.0:1789185554.349904:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898318464 00000100:00100000:1.0:1789185554.349970:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789185554.349976:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000471cfa15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:8099:x1876096898318464:12345-0@lo:502: 00000100:00100000:1.0:1789185554.350074:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000471cfa15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:8099:x1876096898318464:12345-0@lo:502: Request processed in 97us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185554.350083:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789185554.350120:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049e68517 going to sleep for 11 seconds 00000100:00100000:1.0:1789185554.350135:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c671e36 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8099:1876096898318464:0@lo:502: 00000020:01000000:1.0:1789185554.350159:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185554.350171:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185554.350175:0:8099:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789185554.350464:0:8099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f30030e800 00000020:00000080:1.0:1789185554.350469:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789185554.350785:0:8099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300251f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8099:1876096898318592:0@lo:502: 00000100:00100000:1.0:1789185554.350931:0:8099:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185554.351623:0:8099:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f0fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185554.361063:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898318592 00000100:00100000:0.0:1789185554.361088:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898318592 00000100:00100000:1.0:1789185554.361498:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789185554.361512:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:8099:x1876096898318592:12345-0@lo:502: 00000100:00100000:1.0:1789185554.364242:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:8099:x1876096898318592:12345-0@lo:502: Request processed in 2719us (13319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185554.364293:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789185554.373834:0:8099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300251f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8099:1876096898318592:0@lo:502: 00000020:01000000:1.0:1789185554.379255:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185554.379282:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185554.379285:0:8099:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789185554.379299:0:8099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789185554.379634:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789185554.379668:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185554.379686:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185554.379704:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185554.379718:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185554.379722:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2e7ae1000 from 1 10000000:01000000:3.0:1789185554.379726:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185554.379789:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185554.379799:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185554.379814:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185554.379874:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318720:0@lo:101: 00000100:00100000:3.0:1789185554.380070:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185554.380122:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3003683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185554.380212:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898318720 00000100:00100000:1.0:1789185554.380224:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898318720 00000100:00100000:1.0:1789185554.380294:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789185554.380314:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898318720:12345-0@lo:101: 00010000:00010000:1.0:1789185554.380332:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185554.380352:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72ad7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185554.380382:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72ad7 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185554.380395:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ad7 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185554.380406:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166d600, rc 0) 00000100:00100000:1.0:1789185554.380452:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898318720:12345-0@lo:101: Request processed in 149us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185554.380459:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789185554.380876:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318720:0@lo:101: 00010000:00010000:3.0:1789185554.380896:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185554.380939:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185554.381034:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318848:0@lo:501: 00000100:00100000:3.0:1789185554.381072:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185554.381100:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3003683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185554.381172:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898318848 00000100:00100000:1.0:1789185554.381177:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898318848 00000100:00100000:1.0:1789185554.381218:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789185554.381227:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898318848:12345-0@lo:501: 00000100:00100000:1.0:1789185554.382622:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898318848:12345-0@lo:501: Request processed in 1387us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185554.382655:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789185554.382827:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318848:0@lo:501: 00000100:00100000:3.0:1789185554.382895:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318976:0@lo:503: 00000100:00100000:3.0:1789185554.382990:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185554.383033:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3003683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185554.383060:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898318976 00000100:00100000:3.0:1789185554.383070:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898318976 00000100:00100000:3.0:1789185554.383122:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789185554.383132:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898318976:12345-0@lo:503: 00000100:00100000:3.0:1789185554.383290:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898318976:12345-0@lo:503: Request processed in 160us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185554.383298:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789185554.383361:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898318976:0@lo:503: 00000100:00100000:3.0:1789185554.390199:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8101:1876096898319104:0@lo:502: 00000100:00100000:3.0:1789185554.390325:0:8101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185554.390388:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300368000 going to sleep for 11 seconds 00000100:00100000:1.0:1789185554.390456:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898319104 00000100:00100000:1.0:1789185554.390466:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898319104 00000100:00100000:1.0:1789185554.390549:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789185554.390561:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:8101:x1876096898319104:12345-0@lo:502: 00000100:00100000:1.0:1789185554.390721:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:8101:x1876096898319104:12345-0@lo:502: Request processed in 161us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185554.390729:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789185554.393732:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8101:1876096898319104:0@lo:502: 00000020:01000000:3.0:1789185554.393796:0:8101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185554.393813:0:8101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185554.393816:0:8101:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789185554.393825:0:8101:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f2e7ae1000 00000020:00000080:3.0:1789185554.393828:0:8101:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789185554.393881:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8101:1876096898319232:0@lo:502: 00000100:00100000:3.0:1789185554.394005:0:8101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185554.394057:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300368000 going to sleep for 11 seconds 00000100:00100000:1.0:1789185554.394164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898319232 00000100:00100000:1.0:1789185554.394174:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898319232 00000100:00100000:1.0:1789185554.394244:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789185554.394257:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:8101:x1876096898319232:12345-0@lo:502: 00000100:00100000:1.0:1789185554.394427:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:8101:x1876096898319232:12345-0@lo:502: Request processed in 172us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185554.394436:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789185554.394678:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8101:1876096898319232:0@lo:502: 00000020:01000000:3.0:1789185554.394705:0:8101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185554.394710:0:8101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185554.394712:0:8101:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789185554.394716:0:8101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789185554.394946:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789185554.394975:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185554.394988:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185554.395001:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185554.732092:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185555.366276:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898319616:0@lo:400: 00000100:00100000:1.0:1789185555.366366:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185555.366430:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185555.366438:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898319488:0@lo:400: 00000100:00100000:1.0:1789185555.366474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185555.366515:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898319616 00000100:00100000:1.0:1789185555.366524:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898319616 00000100:00100000:1.0:1789185555.366575:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789185555.366585:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898319616:12345-0@lo:400: 00000100:00100000:1.0:1789185555.366641:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898319616:12345-0@lo:400: Request processed in 57us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185555.366661:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789185555.366705:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898319616:0@lo:400: 00000100:00100000:0.0:1789185555.366932:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898319744:0@lo:400: 00000100:00100000:0.0:1789185555.366965:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185555.366987:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789185555.366993:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898319360:0@lo:400: 00000100:00100000:0.0:1789185555.367033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185555.367056:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898319872:0@lo:400: 00000100:00100000:0.0:1789185555.367090:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185555.367224:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898319488 00000100:00100000:1.0:1789185555.367229:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898319488 00000100:00100000:1.0:1789185555.367267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898319744 00000100:00100000:1.0:1789185555.367271:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898319744 00000100:00100000:1.0:1789185555.367288:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185555.367295:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898319488:12345-0@lo:400: 00000100:00100000:3.0:1789185555.367932:0:6513:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789185555.367944:0:6513:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789185555.367961:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898319360 00000100:00100000:3.0:1789185555.367966:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898319360 00000100:00100000:3.0:1789185555.368001:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789185555.368009:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3635:x1876096898319360:12345-0@lo:400: 00000100:00100000:3.0:1789185555.368077:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3635:x1876096898319360:12345-0@lo:400: Request processed in 68us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185555.368084:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789185555.368115:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898319872 00000100:00100000:3.0:1789185555.368130:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898319872 00000100:00100000:3.0:1789185555.368157:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789185555.368163:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898319872:12345-0@lo:400: 00000100:00100000:3.0:1789185555.368205:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898319872:12345-0@lo:400: Request processed in 42us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185555.368210:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789185555.368328:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898319360:0@lo:400: 00000100:00100000:3.0:1789185555.368339:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898319872:0@lo:400: 00000100:00100000:3.0:1789185555.368386:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185555.368393:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898319744:12345-0@lo:400: 00000100:00100000:3.0:1789185555.368429:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898319744:12345-0@lo:400: Request processed in 37us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185555.368435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789185555.368464:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f300251880 x1876096898319744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185555.368476:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898319744:0@lo:400: 00000100:00100000:1.0:1789185555.369481:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898319488:12345-0@lo:400: Request processed in 2179us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185555.369492:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185555.369936:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898320000:0@lo:41: 00000100:00100000:0.0:1789185555.369980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185555.370035:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898320000 00000100:00100000:0.0:1789185555.370042:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898320000 00000100:00100000:0.0:1789185555.370080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185555.370088:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898320000:12345-0@lo:41: 00000004:00000024:0.0:1789185555.370118:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789185555.370158:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898320000:12345-0@lo:41: Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185555.370166:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185555.370217:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898320000:0@lo:41: 00010000:00080000:3.0:1789185555.372246:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f300253b80 x1876096898319488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185555.372267:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898319488:0@lo:400: 00010000:00010000:2.0:1789185555.750191:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185556.779952:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185557.798418:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185558.824165:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185558.956303:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898320128:0@lo:41: 00000100:00100000:1.0:1789185558.956375:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185558.956615:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898320128 00000100:00100000:3.0:1789185558.956624:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898320128 00000100:00100000:3.0:1789185558.956672:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185558.956682:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898320128:12345-0@lo:41: 00000004:00000024:3.0:1789185558.956717:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789185558.960728:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898320128:12345-0@lo:41: Request processed in 4040us (4344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185558.960751:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789185558.963018:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898320128:0@lo:41: 00010000:00010000:2.0:1789185559.849774:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185560.487046:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898320256:0@lo:41: 00000100:00100000:1.0:1789185560.487122:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185560.487298:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898320256 00000100:00100000:0.0:1789185560.487306:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898320256 00000100:00100000:0.0:1789185560.487361:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789185560.487371:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898320256:12345-0@lo:41: 00000004:00000024:0.0:1789185560.487416:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789185560.487474:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898320256:12345-0@lo:41: Request processed in 104us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185560.487481:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789185560.487571:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898320256:0@lo:41: 00000100:00100000:2.0:1789185560.487792:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898320384:0@lo:400: 00000100:00100000:2.0:1789185560.487837:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185560.487869:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185560.487875:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898320768:0@lo:400: 00000100:00100000:2.0:1789185560.487899:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185560.487969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898320768 00000100:00100000:2.0:1789185560.487973:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898320768 00000100:00100000:2.0:1789185560.488002:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789185560.488009:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898320768:12345-0@lo:400: 00000100:00100000:2.0:1789185560.488046:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898320768:12345-0@lo:400: Request processed in 37us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185560.488053:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789185560.488079:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f2f2bd9180 x1876096898320768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185560.488090:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898320768:0@lo:400: 00000100:00100000:1.0:1789185560.488155:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898320640:0@lo:400: 00000100:00100000:1.0:1789185560.488183:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185560.488208:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185560.488222:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898320512:0@lo:400: 00000100:00100000:1.0:1789185560.488244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185560.488268:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898320512 00000100:00100000:1.0:1789185560.488272:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898320512 00000100:00100000:1.0:1789185560.488299:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789185560.488305:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898320512:12345-0@lo:400: 00000100:00100000:1.0:1789185560.488336:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898320512:12345-0@lo:400: Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185560.488343:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789185560.488368:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f2f2bdb800 x1876096898320512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185560.488377:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898320512:0@lo:400: 00000100:00100000:2.0:1789185560.488448:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898320640 00000100:00100000:2.0:1789185560.488452:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898320640 00000100:00100000:2.0:1789185560.488484:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789185560.488490:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898320640:12345-0@lo:400: 00000100:00100000:2.0:1789185560.488523:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898320640:12345-0@lo:400: Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185560.488529:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789185560.488866:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898320640:0@lo:400: 00000100:00100000:3.0:1789185560.489203:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898320384 00000100:00100000:3.0:1789185560.489208:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898320384 00000100:00100000:3.0:1789185560.489254:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789185560.489262:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3636:x1876096898320384:12345-0@lo:400: 00000100:00100000:3.0:1789185560.489309:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3636:x1876096898320384:12345-0@lo:400: Request processed in 49us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185560.489314:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789185560.491006:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898320384:0@lo:400: 00000020:01000004:3.0:1789185560.709386:0:8421:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789185560.709391:0:8421:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789185560.709392:0:8421:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789185560.709540:0:8421:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98f2d26ca000 00000020:01000004:3.0:1789185560.709558:0:8421:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789185560.709572:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789185560.709585:0:8421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98f2c6fd3380) 00000020:00000080:3.0:1789185560.709601:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789185560.750905:0:8421:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789185560.751630:0:8421:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1789185560.773296:0:8421:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789185560.773592:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789185560.773603:0:8421:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789185560.773612:0:8421:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xda5c730d5a72aec 00000020:01000004:1.0:1789185560.773619:0:8421:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789185560.773637:0:8421:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789185560.773640:0:8421:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789185560.773645:0:8421:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789185560.773650:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789185560.773669:0:8421:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98f2f75e3380) 00000020:00000080:1.0:1789185560.773752:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1789185560.775327:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789185560.775518:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789185560.775527:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789185560.778206:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789185560.778220:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789185560.782159:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789185560.782172:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789185560.786114:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185560.786286:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789185560.786292:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789185560.792664:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789185560.793057:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789185560.848235:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185560.848559:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789185560.848566:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789185560.852569:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789185560.852583:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789185560.857820:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789185560.857837:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789185560.863580:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185560.864298:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789185560.864308:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789185560.865301:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789185560.865316:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1789185560.875752:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185560.951237:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185560.951469:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789185560.951476:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789185560.953187:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789185560.953199:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789185560.953559:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789185560.953586:0:8421:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789185560.953593:0:8421:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789185560.987810:0:8421:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789185560.987851:0:8421:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.148@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789185560.987855:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789185560.987858:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185560.987859:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185560.987860:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185560.987861:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185560.987862:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185560.987863:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185560.987865:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185560.987866:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185560.987867:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185560.987868:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185560.987872:0:8421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789185560.987874:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185560.987876:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185560.987877:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185560.987878:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185560.987878:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185560.987879:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185560.987880:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185560.987881:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185560.987882:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185560.987883:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185560.987884:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185560.987939:0:8421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789185560.987959:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898320896:0@lo:253: 00000100:00100000:2.0:1789185560.988281:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185560.988341:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018300 going to sleep for 11 seconds 00000100:00100000:3.0:1789185560.988436:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898320896 00000100:00100000:3.0:1789185560.988444:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898320896 00000100:00100000:3.0:1789185560.988502:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789185560.988511:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:8421:x1876096898320896:12345-0@lo:253: 20000000:01000000:3.0:1789185560.988566:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789185560.988570:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789185560.988574:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789185560.988577:0:6507:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789185560.988783:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185560.988983:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789185560.988998:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789185560.989016:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789185560.989022:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789185560.989033:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789185560.989073:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789185560.989157:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789185560.989171:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.148@tcp 20000000:01000000:3.0:1789185560.989173:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789185560.989187:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789185560.989193:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789185560.989206:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789185560.989210:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:3.0:1789185560.989221:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789185560.989227:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789185560.989238:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789185560.989250:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789185560.989320:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789185560.989330:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.148@tcp 20000000:01000000:3.0:1789185560.989332:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789185560.989346:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789185560.989351:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789185560.989363:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789185560.989368:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:3.0:1789185560.989379:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789185560.989393:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789185560.989421:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789185560.989437:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789185560.989776:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789185560.989789:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.148@tcp 20000000:01000000:3.0:1789185560.989791:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789185560.989804:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789185560.989809:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789185560.989821:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789185560.989825:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:3.0:1789185560.989850:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789185560.989856:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789185560.989874:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789185560.989890:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789185560.989903:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789185560.989932:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789185560.989936:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789185560.989980:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789185560.989983:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789185560.997331:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789185560.997390:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789185560.997422:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789185560.997734:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789185560.997759:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789185560.997774:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789185560.997786:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789185560.997789:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789185561.001596:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789185561.001741:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789185561.001762:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1789185561.002676:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1789185561.002707:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1789185561.002726:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1789185561.002738:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789185561.002741:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789185561.003441:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789185561.003721:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789185561.003747:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789185561.003764:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789185561.003777:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789185561.003779:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789185561.004498:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1789185561.004524:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1789185561.004540:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789185561.004791:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1789185561.004811:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1789185561.004837:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:3.0:1789185561.004851:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789185561.004870:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.004887:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30da200/0xda5c730d5a729c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a729bf expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.004894:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a36 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.004900:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a6e expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.005186:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72a91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a8a expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.005196:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ab4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.005203:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.005243:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72ab4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.005256:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72abb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72ab4 expref: 18 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.005270:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321024:0@lo:104: 00000100:00100000:3.0:1789185561.005332:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185561.005440:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72a8a expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.005455:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72a8a expref: 18 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.005464:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321152:0@lo:104: 00000100:00100000:3.0:1789185561.005488:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185561.005563:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72a6e expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.005570:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72a6e expref: 18 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.005578:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321280:0@lo:104: 00000100:00100000:3.0:1789185561.005598:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185561.005729:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898321024 00000100:00100000:1.0:1789185561.005737:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898321024 00000100:00100000:1.0:1789185561.005776:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898321152 00000100:00100000:1.0:1789185561.005780:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898321152 00000100:00100000:1.0:1789185561.005812:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789185561.005820:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6507:x1876096898321024:12345-0@lo:104: 00010000:00010000:1.0:1789185561.005833:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a72ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.005893:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789185561.005899:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6507:x1876096898321024:12345-0@lo:104: Request processed in 80us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.005928:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789185561.005947:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185561.005954:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6507:x1876096898321152:12345-0@lo:104: 00010000:00010000:1.0:1789185561.005961:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.005996:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789185561.006001:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6507:x1876096898321152:12345-0@lo:104: Request processed in 48us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.006007:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789185561.006121:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185561.006128:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a72ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006136:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3e00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185561.006140:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a72ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006159:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a72ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185561.006166:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a72ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185561.006171:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185561.006202:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a72ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006208:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185561.006226:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a72ab4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006233:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a72ab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72abb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006247:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185561.006251:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006256:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185561.006259:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006266:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185561.006272:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185561.006283:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185561.006297:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006302:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185561.006316:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72a8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006323:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006332:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185561.006334:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185561.006336:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185561.006355:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898321408:0@lo:103: 00000100:00100000:0.0:1789185561.006395:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.006446:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898321536:0@lo:103: 00000100:00100000:0.0:1789185561.006468:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.006504:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898321408 00000100:00100000:0.0:1789185561.006508:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898321408 00010000:00010000:0.0:1789185561.006526:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72abb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ab4 expref: 19 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185561.006546:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898321536 00000100:00100000:0.0:1789185561.006549:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898321536 00010000:00010000:0.0:1789185561.006560:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72a91 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a8a expref: 20 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185561.006572:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185561.006584:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:3636:x1876096898321408:12345-0@lo:103: 00010000:00010000:0.0:1789185561.006595:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185561.006600:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72abb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ab4 expref: 20 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006610:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72abb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72ab4 expref: 20 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006829:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185561.006871:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:3636:x1876096898321408:12345-0@lo:103: Request processed in 286us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.006878:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185561.006894:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185561.006901:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3637:x1876096898321536:12345-0@lo:103: 00010000:00010000:0.0:1789185561.006956:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185561.006962:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72a91 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a8a expref: 19 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006972:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72a8a expref: 19 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.006981:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185561.007007:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3637:x1876096898321536:12345-0@lo:103: Request processed in 108us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.007013:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185561.007060:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898321536:0@lo:103: 00000100:00100000:1.0:1789185561.007168:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898321408:0@lo:103: 00010000:00010000:3.0:1789185561.007376:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72a36 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.007387:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72a3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72a36 expref: 18 pid: 6505 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.007406:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321664:0@lo:104: 00000100:00100000:3.0:1789185561.007433:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185561.007525:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30da200/0xda5c730d5a729c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a729bf expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.007535:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30da200/0xda5c730d5a729c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a729bf expref: 18 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.007543:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321792:0@lo:104: 00000100:00100000:3.0:1789185561.007571:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.007589:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898321280 00000100:00100000:2.0:1789185561.007594:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898321280 00000100:00100000:2.0:1789185561.007619:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898321664 00000100:00100000:2.0:1789185561.007622:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898321664 00000100:00100000:2.0:1789185561.007647:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789185561.007655:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6507:x1876096898321280:12345-0@lo:104: 00010000:00010000:2.0:1789185561.007671:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a72a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007717:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185561.007722:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6507:x1876096898321280:12345-0@lo:104: Request processed in 69us (2124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.007728:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789185561.007743:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789185561.007749:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6507:x1876096898321664:12345-0@lo:104: 00010000:00010000:2.0:1789185561.007757:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166d200/0xda5c730d5a72a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007782:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789185561.007787:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6507:x1876096898321664:12345-0@lo:104: Request processed in 39us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.007792:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789185561.007809:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185561.007813:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a72a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007820:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:2.0:1789185561.007823:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a72a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007831:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a72a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185561.007837:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a72a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.007848:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185561.007875:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a72a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007881:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185561.007891:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a72a6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007898:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a72a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007932:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185561.007937:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166d200/0xda5c730d5a72a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007942:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:2.0:1789185561.007945:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166d200/0xda5c730d5a72a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007951:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166d200/0xda5c730d5a72a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185561.007958:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166d200/0xda5c730d5a72a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.007963:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185561.007975:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166d200/0xda5c730d5a72a36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.007982:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185561.008001:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166d200/0xda5c730d5a72a36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.008008:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166d200/0xda5c730d5a72a36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a3d expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.008018:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185561.008019:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185561.008021:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185561.008027:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185561.008035:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898322048:0@lo:103: 00000100:00100000:0.0:1789185561.008280:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898321920:0@lo:103: 00000100:00100000:0.0:1789185561.008309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185561.008361:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185561.008414:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898321920 00000100:00100000:1.0:1789185561.008419:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898321920 00010000:00010000:1.0:1789185561.008438:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72a75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a6e expref: 19 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185561.008465:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789185561.008471:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3638:x1876096898321920:12345-0@lo:103: 00010000:00010000:1.0:1789185561.008480:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185561.008484:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72a75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a6e expref: 19 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.008492:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72a6e expref: 19 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.008505:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185561.008532:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3638:x1876096898321920:12345-0@lo:103: Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.008538:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789185561.008596:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.008727:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898322048 00000100:00100000:0.0:1789185561.008732:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898322048 00010000:00010000:0.0:1789185561.008747:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72a3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a36 expref: 19 pid: 6505 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185561.008775:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185561.008781:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3636:x1876096898322048:12345-0@lo:103: 00010000:00010000:0.0:1789185561.008788:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185561.008792:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72a3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a36 expref: 19 pid: 6505 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.008800:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72a3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72a36 expref: 19 pid: 6505 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.008809:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185561.008836:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3636:x1876096898322048:12345-0@lo:103: Request processed in 56us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.008841:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185561.008868:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898321920:0@lo:103: 00000100:00100000:0.0:1789185561.008891:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898322048:0@lo:103: 00000100:00100000:3.0:1789185561.009195:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c19096c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789185561.009210:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72ab4 expref: 18 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.009221:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321024:0@lo:104: 00010000:00010000:3.0:1789185561.009230:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72a91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72a8a expref: 17 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.009236:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321152:0@lo:104: 00010000:00010000:3.0:1789185561.009244:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72a6e expref: 16 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.009251:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321280:0@lo:104: 00010000:00010000:3.0:1789185561.009259:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72a3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72a36 expref: 15 pid: 6505 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.009266:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321664:0@lo:104: 00000100:00100000:2.0:1789185561.009416:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898321792 00000100:00100000:2.0:1789185561.009421:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898321792 00000100:00100000:2.0:1789185561.009485:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789185561.009493:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6507:x1876096898321792:12345-0@lo:104: 00010000:00010000:2.0:1789185561.009502:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3000/0xda5c730d5a729bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.009588:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185561.009594:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6507:x1876096898321792:12345-0@lo:104: Request processed in 103us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.009599:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185561.009750:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1876096898321792:0@lo:104: 00010000:00010000:3.0:1789185561.009779:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010303:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185561.010311:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3000/0xda5c730d5a729bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010319:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185561.010322:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3000/0xda5c730d5a729bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010347:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3000/0xda5c730d5a729bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185561.010354:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3000/0xda5c730d5a729bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185561.010359:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185561.010444:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3000/0xda5c730d5a729bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010450:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185561.010475:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3000/0xda5c730d5a729bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010481:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3000/0xda5c730d5a729bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a729c6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010499:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185561.010500:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185561.010502:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185561.010510:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185561.010524:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898322176:0@lo:103: 00000100:00100000:0.0:1789185561.010568:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.010605:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898322176 00000100:00100000:0.0:1789185561.010610:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898322176 00010000:00010000:0.0:1789185561.010749:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30da200/0xda5c730d5a729c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a729bf expref: 15 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185561.010784:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789185561.010792:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce0ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:3635:x1876096898322176:12345-0@lo:103: 00010000:00010000:0.0:1789185561.010808:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185561.010814:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30da200/0xda5c730d5a729c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a729bf expref: 15 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010823:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30da200/0xda5c730d5a729c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a729bf expref: 15 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010835:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30da200/0xda5c730d5a729c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a729bf expref: 15 pid: 6507 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010849:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010856:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010869:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010876:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010882:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010888:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010892:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185561.010896:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010939:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010954:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.010963:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185561.010996:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce0ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:3635:x1876096898322176:12345-0@lo:103: Request processed in 205us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.011002:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789185561.011219:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898322176:0@lo:103: 00010000:00010000:0.0:1789185561.011241:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.011248:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.011253:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30da000/0xda5c730d5a72afa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789185561.011266:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789185561.014327:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+13:8421:x1876096898320896:12345-0@lo:253: Request processed in 25804us (26035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.014341:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789185561.015187:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898320896:0@lo:253: 10000000:01000000:2.0:1789185561.015203:0:8421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789185561.015207:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185561.015209:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185561.015210:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185561.015211:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789185561.015213:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185561.015227:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185561.015228:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185561.015230:0:8421:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789185561.015232:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185561.015233:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789185561.015254:0:8421:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f2d26ca000 from lustre-OST0000 10000000:01000000:2.0:1789185561.015281:0:8421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789185561.015284:0:8421:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789185561.015292:0:8421:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f2c6fd4d40 local copy 10000000:01000000:2.0:1789185561.015296:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789185561.015330:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.015341:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.015349:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.015366:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322304:0@lo:101: 00000100:00100000:2.0:1789185561.015421:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.015451:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce0186c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.015669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898322304 00000100:00100000:1.0:1789185561.015735:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898322304 00000100:00100000:1.0:1789185561.015828:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789185561.015840:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+13:8421:x1876096898322304:12345-0@lo:101: 00010000:00010000:1.0:1789185561.015854:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185561.015868:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72b01 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.015894:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72b01 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.015904:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b01 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.015958:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166da00, rc 0) 00000100:00100000:1.0:1789185561.016014:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898322304:12345-0@lo:101: Request processed in 176us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.016022:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789185561.016048:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322304:0@lo:101: 00010000:00010000:0.0:1789185561.016065:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.016087:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185561.016191:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322432:0@lo:501: 00000100:00100000:0.0:1789185561.016222:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.016256:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.016310:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898322432 00000100:00100000:3.0:1789185561.016315:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898322432 00000100:00100000:3.0:1789185561.016351:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789185561.016358:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898322432:12345-0@lo:501: 00000100:00100000:3.0:1789185561.016443:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898322432:12345-0@lo:501: Request processed in 86us (220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185561.016459:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789185561.016535:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322432:0@lo:501: 10000000:01000000:0.0:1789185561.016550:0:8421:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789185561.016568:0:8421:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789185561.016573:0:8421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.016581:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.016587:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.016613:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789185561.016639:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f2d26ca000 10000000:01000000:0.0:1789185561.016644:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789185561.016649:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789185561.016651:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789185561.016655:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789185561.016657:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789185561.016675:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.016682:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185561.016690:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.016694:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.016705:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfc00 already unused, calling callback (ffffffffc131bc20) 00010000:00010000:0.0:1789185561.016709:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185561.016711:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.016729:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185561.016732:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322560:0@lo:101: 10000000:00010000:2.0:1789185561.016756:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.016761:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789185561.016768:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185561.016786:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.016794:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789185561.016795:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75ad3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789185561.016817:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.016825:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xda5c730d5a72b08 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.016836:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185561.016837:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185561.016839:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185561.016850:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898322688:0@lo:103: 00000100:00100000:2.0:1789185561.016879:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.016984:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898322688 00000100:00100000:0.0:1789185561.016989:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898322688 00000100:00100000:0.0:1789185561.017033:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185561.017041:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+14:3637:x1876096898322688:12345-0@lo:103: 00010000:00010000:0.0:1789185561.017050:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185561.017062:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72b01 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.017074:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185561.017101:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2708700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+13:3637:x1876096898322688:12345-0@lo:103: Request processed in 62us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.017107:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185561.017223:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898322560 00000100:00100000:3.0:1789185561.017227:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898322560 00000100:00100000:3.0:1789185561.017255:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789185561.017262:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+13:8421:x1876096898322560:12345-0@lo:101: 00010000:00010000:3.0:1789185561.017270:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185561.017280:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72b0f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.017296:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72b0f expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.017304:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b0f expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.017310:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da800, rc 0) 00000100:00100000:3.0:1789185561.017337:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898322560:12345-0@lo:101: Request processed in 76us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.017343:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789185561.017467:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322560:0@lo:101: 00010000:00010000:0.0:1789185561.017478:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.017486:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185561.017565:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322816:0@lo:501: 00000100:00100000:0.0:1789185561.017590:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.017618:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.017633:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898322816 00000100:00100000:0.0:1789185561.017637:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898322816 00000100:00100000:0.0:1789185561.017655:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789185561.017661:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898322816:12345-0@lo:501: 00000100:00100000:0.0:1789185561.017757:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898322816:12345-0@lo:501: Request processed in 94us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.017780:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789185561.017844:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898322688:0@lo:103: 00000100:00100000:0.0:1789185561.018554:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322816:0@lo:501: 00000100:00100000:0.0:1789185561.018586:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322944:0@lo:503: 00000100:00100000:0.0:1789185561.018630:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.018694:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.019200:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898322944 00000100:00100000:1.0:1789185561.019207:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898322944 00000100:00100000:0.0:1789185561.019357:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789185561.019365:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898322944:12345-0@lo:503: 00000100:00100000:0.0:1789185561.019498:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898322944:12345-0@lo:503: Request processed in 133us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.019505:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789185561.019583:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898322944:0@lo:503: 00000040:00080000:1.0:1789185561.019843:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789185561.019956:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323072:0@lo:502: 00000100:00100000:1.0:1789185561.020002:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185561.023388:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ab6840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.023492:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898323072 00000100:00100000:3.0:1789185561.023502:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898323072 00000100:00100000:3.0:1789185561.023550:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789185561.023558:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898323072:12345-0@lo:502: 00000100:00100000:3.0:1789185561.023704:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898323072:12345-0@lo:502: Request processed in 146us (3702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.023712:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789185561.023803:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323072:0@lo:502: 00000040:00080000:1.0:1789185561.024169:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789185561.024195:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789185561.024206:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789185561.024217:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789185561.024227:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789185561.024238:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789185561.024268:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323200:0@lo:502: 00000100:00100000:1.0:1789185561.024307:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185561.024335:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ab6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.024432:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898323200 00000100:00100000:2.0:1789185561.024439:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898323200 00000100:00100000:2.0:1789185561.024482:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789185561.024536:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898323200:12345-0@lo:502: 00000100:00100000:1.0:1789185561.024627:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898323200:12345-0@lo:502: Request processed in 138us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.024633:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789185561.024694:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323200:0@lo:502: 00000040:00080000:2.0:1789185561.024754:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789185561.024763:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789185561.027801:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789185561.027813:0:8444:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789185561.027820:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185561.027823:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789185561.027830:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185561.027848:0:8444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98f2f75e4d40) 00000020:00000080:1.0:1789185561.027879:0:8444:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789185561.027887:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789185561.028019:0:8444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f2d26ca000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789185561.028029:0:8444:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789185561.028036:0:8444:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xda5c730d5a72b24 00010000:00010000:1.0:1789185561.036000:0:8444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789185561.038360:0:8444:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789185561.044290:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789185561.044740:0:8444:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789185561.055625:0:8444:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789185561.056529:0:8444:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789185561.067683:0:8444:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789185561.069361:0:8444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789185561.069373:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185561.069385:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185561.069387:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789185561.069391:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185561.069406:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185561.069408:0:8444:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789185561.069411:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789185561.069413:0:8444:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789185561.069438:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185561.069442:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185561.069443:0:8444:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789185561.069446:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789185561.070293:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789185561.070338:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789185561.073673:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.073693:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.073702:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2d26ca000 from 1 10000000:01000000:2.0:1789185561.073706:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185561.073744:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.073754:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.073765:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.073788:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323328:0@lo:101: 00000100:00100000:2.0:1789185561.073859:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.073930:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.075963:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898323328 00000100:00100000:3.0:1789185561.075977:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898323328 00000100:00100000:3.0:1789185561.076032:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789185561.076043:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:8421:x1876096898323328:12345-0@lo:101: 00010000:00010000:3.0:1789185561.076058:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185561.076077:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72b2b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.076105:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72b2b expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.076116:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b2b expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.076124:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dac00, rc 0) 00000100:00100000:3.0:1789185561.076190:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323328:12345-0@lo:101: Request processed in 150us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.076197:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789185561.076552:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323328:0@lo:101: 00010000:00010000:2.0:1789185561.076571:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.076580:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.076699:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323456:0@lo:501: 00000100:00100000:2.0:1789185561.076733:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.076889:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.076978:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898323456 00000100:00100000:0.0:1789185561.076989:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898323456 00000100:00100000:0.0:1789185561.077025:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789185561.077033:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323456:12345-0@lo:501: 00000100:00100000:0.0:1789185561.077394:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323456:12345-0@lo:501: Request processed in 361us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.077415:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789185561.077496:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323456:0@lo:501: 00000100:00100000:2.0:1789185561.077530:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323584:0@lo:503: 00000100:00100000:2.0:1789185561.077572:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.077603:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.077665:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898323584 00000100:00100000:1.0:1789185561.077723:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898323584 00000100:00100000:1.0:1789185561.077832:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789185561.077840:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323584:12345-0@lo:503: 00000100:00100000:1.0:1789185561.078006:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323584:12345-0@lo:503: Request processed in 166us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.078012:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789185561.078183:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323584:0@lo:503: 00000040:00080000:2.0:1789185561.078632:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789185561.078725:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323712:0@lo:502: 00000100:00100000:2.0:1789185561.078778:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.078810:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.078940:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898323712 00000100:00100000:0.0:1789185561.078946:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898323712 00000100:00100000:0.0:1789185561.078983:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789185561.078990:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323712:12345-0@lo:502: 00000100:00100000:0.0:1789185561.079087:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323712:12345-0@lo:502: Request processed in 98us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.079094:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789185561.079115:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323712:0@lo:502: 00000040:00080000:2.0:1789185561.079456:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789185561.079475:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789185561.079490:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323840:0@lo:502: 00000100:00100000:2.0:1789185561.079514:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.079537:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.079551:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898323840 00000100:00100000:1.0:1789185561.079555:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898323840 00000100:00100000:1.0:1789185561.079582:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789185561.079588:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323840:12345-0@lo:502: 00000100:00100000:1.0:1789185561.079667:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323840:12345-0@lo:502: Request processed in 78us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.079735:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789185561.079759:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323840:0@lo:502: 00000040:00080000:2.0:1789185561.079795:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789185561.079802:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789185561.080494:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185561.080503:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185561.080505:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789185561.080519:0:8448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f2d26ca000 00000020:00000080:1.0:1789185561.080521:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185561.080534:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185561.080537:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185561.080539:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789185561.080542:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789185561.080733:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789185561.080760:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185561.080784:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.080796:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.080852:0:8421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789185561.080855:0:8421:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f2d26ca000 10000000:01000000:2.0:1789185561.080858:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f2d26ca000 10000000:01000000:2.0:1789185561.080862:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789185561.080867:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2d26ca000 from 1 10000000:01000000:2.0:1789185561.080870:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789185561.080897:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.080932:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.080943:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.080960:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323968:0@lo:101: 00000100:00100000:2.0:1789185561.081002:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.081037:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.081155:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898323968 00000100:00100000:3.0:1789185561.081161:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898323968 00000100:00100000:3.0:1789185561.081247:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789185561.081257:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8421:x1876096898323968:12345-0@lo:101: 00010000:00010000:3.0:1789185561.081267:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185561.081279:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72b39 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.081416:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72b39 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.081428:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b39 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.081437:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30daa00, rc 0) 00000100:00100000:3.0:1789185561.081485:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898323968:12345-0@lo:101: Request processed in 230us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.081498:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789185561.081586:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898323968:0@lo:101: 00010000:00010000:2.0:1789185561.081600:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.081614:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.081864:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898324096:0@lo:501: 00000100:00100000:2.0:1789185561.081889:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.082003:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.082063:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898324096 00000100:00100000:1.0:1789185561.082068:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898324096 00000100:00100000:1.0:1789185561.082098:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789185561.082105:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898324096:12345-0@lo:501: 00000100:00100000:1.0:1789185561.082709:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898324096:12345-0@lo:501: Request processed in 601us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.082717:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789185561.082779:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898324096:0@lo:501: 00000100:00100000:3.0:1789185561.082810:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898324224:0@lo:503: 00000100:00100000:3.0:1789185561.082853:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.082880:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c1909240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.083582:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898324224 00000100:00100000:0.0:1789185561.083590:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898324224 00000100:00100000:0.0:1789185561.083639:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789185561.083648:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898324224:12345-0@lo:503: 00000100:00100000:0.0:1789185561.083775:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898324224:12345-0@lo:503: Request processed in 128us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.083782:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789185561.083842:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898324224:0@lo:503: 00000040:00080000:2.0:1789185561.084117:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789185561.084183:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2709f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898324352:0@lo:502: 00000100:00100000:2.0:1789185561.084244:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185561.084380:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898324352 00000100:00100000:1.0:1789185561.084385:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898324352 00000100:00100000:2.0:1789185561.084423:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018840 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.085033:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789185561.085044:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898324352:12345-0@lo:502: 00000100:00100000:1.0:1789185561.085278:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898324352:12345-0@lo:502: Request processed in 237us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.085294:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789185561.085472:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2709f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898324352:0@lo:502: 00000040:00080000:2.0:1789185561.085750:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789185561.085795:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789185561.085811:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789185561.085824:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789185561.085835:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789185561.085847:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789185561.085860:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789185561.085873:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789185561.085889:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789185561.085904:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789185561.087274:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789185561.087505:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789185561.087522:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789185561.087535:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789185561.087549:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789185561.087563:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789185561.087576:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789185561.087589:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789185561.087603:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789185561.087634:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789185561.087647:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789185561.087661:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789185561.087673:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789185561.087689:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789185561.087703:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789185561.087716:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789185561.087730:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789185561.087742:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789185561.087755:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789185561.087769:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789185561.087781:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789185561.087794:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789185561.087808:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789185561.087822:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789185561.087835:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789185561.087850:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789185561.087864:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789185561.088658:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898324480:0@lo:502: 00000100:00100000:3.0:1789185561.089277:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.089483:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c1909d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.089533:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898324480 00000100:00100000:1.0:1789185561.089542:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898324480 00000100:00100000:1.0:1789185561.089654:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789185561.089664:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898324480:12345-0@lo:502: 00000100:00100000:1.0:1789185561.089816:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898324480:12345-0@lo:502: Request processed in 152us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.089824:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789185561.089905:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898324480:0@lo:502: 00000040:00080000:3.0:1789185561.090001:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789185561.090013:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789185561.091117:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789185561.091146:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98f1c20719c0) 00000020:00000080:3.0:1789185561.091170:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789185561.092014:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f2d26ca000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789185561.092021:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2d26ca000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789185561.092024:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2d26ca000 3 00010000:00080000:3.0:1789185561.092066:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c207d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.148@tcp at head 00010000:00010000:3.0:1789185561.094422:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789185561.094677:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789185561.094726:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789185561.094745:0:8449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xda5c730d5a72b4e 00000100:00080000:3.0:1789185561.094757:0:8449:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185561.094770:0:8449:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f1c207d800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185561.094819:0:8449:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b7b80 x1876096898324608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185561.094847:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789185561.096860:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898324864:0@lo:400: 00000100:00100000:0.0:1789185561.096960:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.096995:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185561.097001:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898324992:0@lo:400: 00000100:00100000:0.0:1789185561.097025:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.097060:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898324864 00000100:00100000:0.0:1789185561.097068:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898324864 00000100:00100000:0.0:1789185561.097117:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185561.097125:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898324864:12345-0@lo:400: 00000100:00100000:0.0:1789185561.097179:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898324864:12345-0@lo:400: Request processed in 54us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.097186:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185561.097223:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898324864:0@lo:400: 00000100:00100000:2.0:1789185561.097298:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898324608:0@lo:38: 00000100:00100000:2.0:1789185561.097343:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.097419:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898325120:0@lo:400: 00000100:00100000:2.0:1789185561.097590:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.097614:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185561.097728:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898324736:0@lo:400: 00000100:00100000:0.0:1789185561.097761:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898325120 00000100:00100000:0.0:1789185561.097768:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898325120 00000100:00100000:2.0:1789185561.097773:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.097800:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789185561.097808:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898325120:12345-0@lo:400: 00000100:00100000:2.0:1789185561.097816:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898324992 00000100:00100000:2.0:1789185561.097822:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898324992 00000100:00100000:0.0:1789185561.097856:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898325120:12345-0@lo:400: Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.097857:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898324608 00000100:00100000:2.0:1789185561.097862:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898324608 00000100:00100000:0.0:1789185561.097867:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789185561.097877:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898324736 00000100:00100000:2.0:1789185561.097888:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898324736 00000100:00100000:2.0:1789185561.097925:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789185561.097932:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898324992:12345-0@lo:400: 00000100:00100000:1.0:1789185561.097961:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789185561.097968:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876096898324608:12345-0@lo:38: 00000100:00100000:2.0:1789185561.097971:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898324992:12345-0@lo:400: Request processed in 38us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.097981:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789185561.097998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789185561.098003:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000100:00100000:2.0:1789185561.098008:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898324736:12345-0@lo:400: 00000100:00100000:2.0:1789185561.098044:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898324736:12345-0@lo:400: Request processed in 39us (272us total) trans 0 rc 0/0 00000020:00000080:1.0:1789185561.098044:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xda5c730d5a72b55 00000100:00100000:2.0:1789185561.098053:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00100000:1.0:1789185561.098063:0:6514:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789185561.098094:0:6514:0:(import.c:65:import_set_state_nolock()) ffff98f301c26000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1789185561.098110:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c19b3480 x1876096898324736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185561.098123:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898324736:0@lo:400: 00000100:00100000:2.0:1789185561.098137:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898325120:0@lo:400: 00000100:00100000:1.0:1789185561.098146:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876096898324608:12345-0@lo:38: Request processed in 175us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.098154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789185561.098172:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c19b7b80 x1876096898324608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185561.098181:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789185561.098187:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789185561.098195:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789185561.098199:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789185561.098201:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c207d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789185561.098207:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898324608:0@lo:38: 00010000:00080000:0.0:1789185561.098238:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c19b1c00 x1876096898324992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185561.098249:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898324992:0@lo:400: 00000020:01000004:3.0:1789185561.098588:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789185561.098605:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98f1c2070000) 00000020:00000080:3.0:1789185561.098623:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789185561.098707:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f2d26ca000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789185561.098710:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2d26ca000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789185561.098713:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2d26ca000 3 00010000:00080000:3.0:1789185561.098736:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c2079000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.148@tcp at head 00010000:00010000:3.0:1789185561.101891:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789185561.102117:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789185561.102162:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789185561.102175:0:8449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xda5c730d5a72b63 00000100:00080000:3.0:1789185561.102185:0:8449:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185561.102212:0:8449:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98f1c2079000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185561.102250:0:8449:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b5880 x1876096898325248/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185561.102344:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876096898325248:0@lo:38: 00000100:00080000:3.0:1789185561.102353:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789185561.102448:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.102528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898325248 00000100:00100000:2.0:1789185561.102537:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898325248 00000100:00100000:2.0:1789185561.102590:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789185561.102600:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876096898325248:12345-0@lo:38: 00010000:00080000:2.0:1789185561.102632:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1789185561.102668:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xda5c730d5a72b6a 00000004:00100000:2.0:1789185561.102684:0:6513:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789185561.102716:0:6513:0:(import.c:65:import_set_state_nolock()) ffff98f2f27ad800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185561.102784:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876096898325248:12345-0@lo:38: Request processed in 179us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.102793:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789185561.102838:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c19b5880 x1876096898325248/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185561.102848:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789185561.102855:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789185561.102862:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789185561.102866:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789185561.102868:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c2079000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789185561.102875:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876096898325248:0@lo:38: 00000040:00080000:0.0:1789185561.106074:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789185561.108374:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789185561.108425:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789185561.108448:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.108471:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789185561.108631:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789185561.108634:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789185561.108636:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185561.108637:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185561.108638:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185561.108640:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185561.108641:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185561.108643:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789185561.108644:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789185561.108646:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185561.108647:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789185561.108652:0:8421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789185561.108655:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789185561.108656:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789185561.108658:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185561.108659:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185561.108660:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185561.108661:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185561.108662:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185561.108663:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789185561.108664:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789185561.108665:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185561.108666:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789185561.108697:0:8421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789185561.108715:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898325376:0@lo:253: 00000100:00100000:3.0:1789185561.108789:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.108827:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c1909900 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.110333:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898325376 00000100:00100000:0.0:1789185561.110346:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898325376 00000100:00100000:0.0:1789185561.110418:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789185561.110428:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898325376:12345-0@lo:253: 20000000:01000000:0.0:1789185561.110460:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789185561.110474:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789185561.115718:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789185561.115763:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789185561.116067:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789185561.116072:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789185561.116095:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.116129:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c0031a00/0xda5c730d5a72a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a60 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.116137:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30dba00/0xda5c730d5a72a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72a7c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.116144:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.116182:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30dba00/0xda5c730d5a72a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72a7c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185561.116685:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:8421:x1876096898325376:12345-0@lo:253: Request processed in 6255us (7893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.116696:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00010000:3.0:1789185561.116828:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30dba00/0xda5c730d5a72a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72a7c expref: 15 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.116845:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898325504:0@lo:104: 00000100:00100000:3.0:1789185561.116883:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185561.117141:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789185561.117156:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898325504 00000100:00100000:1.0:1789185561.117164:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898325504 00010000:00010000:3.0:1789185561.117624:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c0031a00/0xda5c730d5a72a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72a60 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.117637:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c0031a00/0xda5c730d5a72a67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72a60 expref: 15 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.117646:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898325632:0@lo:104: 00000100:00100000:3.0:1789185561.117678:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.117775:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c1909600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.117817:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:8421:1876096898325376:0@lo:253: 10000000:01000000:3.0:1789185561.117828:0:8421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789185561.117843:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789185561.117844:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789185561.117846:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185561.117847:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185561.117848:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185561.117849:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185561.117851:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185561.117852:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789185561.117853:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789185561.117855:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185561.117857:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789185561.117875:0:8421:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789185561.122228:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898325632 00000100:00100000:1.0:1789185561.122242:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898325632 00000100:00100000:1.0:1789185561.122303:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185561.122315:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6528:x1876096898325504:12345-0@lo:104: 00010000:00010000:1.0:1789185561.122332:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.122443:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789185561.122449:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6528:x1876096898325504:12345-0@lo:104: Request processed in 137us (5566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.122455:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185561.122498:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185561.122505:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6528:x1876096898325632:12345-0@lo:104: 00010000:00010000:1.0:1789185561.122528:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.122563:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789185561.122568:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6528:x1876096898325632:12345-0@lo:104: Request processed in 65us (4890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.122575:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185561.122614:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898325504:0@lo:104: 00000100:00100000:1.0:1789185561.122623:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898325632:0@lo:104: 00010000:00010000:1.0:1789185561.122646:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789185561.123019:0:8421:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789185561.123447:0:8421:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789185561.123743:0:8421:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789185561.123898:0:8421:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789185561.124155:0:8421:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789185561.124855:0:8421:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1789185561.125627:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185561.125638:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125649:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:2.0:1789185561.125653:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125685:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185561.125692:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.125698:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185561.125756:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125763:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185561.125784:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72a7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125791:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125803:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185561.125806:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125812:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:2.0:1789185561.125815:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125821:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185561.125827:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.125837:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789185561.125850:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125856:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185561.125871:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72a60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125877:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72a67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.125892:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185561.125894:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185561.125895:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185561.125930:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898325760:0@lo:103: 00000100:00100000:2.0:1789185561.126016:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.126084:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898325888:0@lo:103: 00000100:00100000:2.0:1789185561.126135:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.126180:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898325760 00000100:00100000:2.0:1789185561.126189:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898325760 00010000:00010000:2.0:1789185561.126226:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30dba00/0xda5c730d5a72a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a7c expref: 16 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.126254:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898325888 00000100:00100000:2.0:1789185561.126257:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898325888 00010000:00010000:2.0:1789185561.126269:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c0031a00/0xda5c730d5a72a67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a60 expref: 17 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.126293:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789185561.126309:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:3638:x1876096898325760:12345-0@lo:103: 00010000:00010000:2.0:1789185561.126322:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185561.126328:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30dba00/0xda5c730d5a72a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a7c expref: 17 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126340:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30dba00/0xda5c730d5a72a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72a7c expref: 17 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126354:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30dba00/0xda5c730d5a72a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72a7c expref: 17 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126366:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185561.126418:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3638:x1876096898325760:12345-0@lo:103: Request processed in 109us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.126424:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789185561.126441:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789185561.126447:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:3635:x1876096898325888:12345-0@lo:103: 00010000:00010000:2.0:1789185561.126455:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185561.126459:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c0031a00/0xda5c730d5a72a67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72a60 expref: 15 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126468:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c0031a00/0xda5c730d5a72a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72a60 expref: 15 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126477:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031a00/0xda5c730d5a72a67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72a60 expref: 15 pid: 6506 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126488:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126508:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789185561.126525:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010452144s 00010000:00010000:2.0:1789185561.126530:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126536:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126543:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126551:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126556:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dae00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185561.126560:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126567:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126583:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126593:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:1.0:1789185561.126615:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789185561.126620:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+14:3635:x1876096898325888:12345-0@lo:103: Request processed in 173us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.126626:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789185561.126668:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898325888:0@lo:103: 00000100:00100000:2.0:1789185561.126690:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898325760:0@lo:103: 00010000:00010000:2.0:1789185561.126704:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126713:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.126720:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30dae00/0xda5c730d5a72b71 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.127190:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789185561.141753:0:8421:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789185561.141765:0:8421:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789185561.141806:0:8421:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789185561.143531:0:8421:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789185561.143665:0:8421:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789185561.143698:0:8421:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789185561.144666:0:8421:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185561.144855:0:8421:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 10000000:01000000:2.0:1789185561.240020:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789185561.240027:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f30030e800 from 30 10000000:01000000:2.0:1789185561.240031:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789185561.240081:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.240094:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.240106:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.240129:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326016:0@lo:101: 00000100:00100000:2.0:1789185561.240189:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.240250:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.240279:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898326016 00000100:00100000:2.0:1789185561.240285:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898326016 00000100:00100000:2.0:1789185561.240337:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789185561.240355:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:6509:x1876096898326016:12345-0@lo:101: 00010000:00010000:2.0:1789185561.240369:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185561.240381:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72b78 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.240413:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72b78 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.240424:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b78 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.240433:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf000, rc 0) 00000100:00100000:2.0:1789185561.240469:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898326016:12345-0@lo:101: Request processed in 116us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.240475:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789185561.240759:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326016:0@lo:101: 00010000:00010000:2.0:1789185561.240775:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.240784:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.240837:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326144:0@lo:501: 00000100:00100000:2.0:1789185561.240860:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.240880:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.240894:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898326144 00000100:00100000:2.0:1789185561.240898:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898326144 00000100:00100000:2.0:1789185561.241362:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789185561.241375:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898326144:12345-0@lo:501: 00000100:00100000:2.0:1789185561.241516:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898326144:12345-0@lo:501: Request processed in 146us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.241696:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789185561.241928:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326144:0@lo:501: 00000100:00100000:2.0:1789185561.241965:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326272:0@lo:503: 00000100:00100000:2.0:1789185561.242019:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.242042:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.242059:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898326272 00000100:00100000:2.0:1789185561.242064:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898326272 00000100:00100000:2.0:1789185561.242096:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789185561.242105:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898326272:12345-0@lo:503: 00000100:00100000:2.0:1789185561.242588:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898326272:12345-0@lo:503: Request processed in 103us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.242599:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789185561.242644:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326272:0@lo:503: 00000100:00100000:2.0:1789185561.243444:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8461:1876096898326400:0@lo:502: 00000100:00100000:2.0:1789185561.243486:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.243522:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.243609:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898326400 00000100:00100000:0.0:1789185561.243614:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898326400 00000100:00100000:0.0:1789185561.243648:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789185561.243656:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8461:x1876096898326400:12345-0@lo:502: 00000100:00100000:0.0:1789185561.243761:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8461:x1876096898326400:12345-0@lo:502: Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.243768:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789185561.243886:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8461:1876096898326400:0@lo:502: 00000100:00100000:2.0:1789185561.243957:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8461:1876096898326528:0@lo:502: 00000100:00100000:2.0:1789185561.243990:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.244008:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.244065:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898326528 00000100:00100000:0.0:1789185561.244069:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898326528 00000100:00100000:0.0:1789185561.244103:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789185561.244111:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8461:x1876096898326528:12345-0@lo:502: 00000100:00100000:0.0:1789185561.244175:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:8461:x1876096898326528:12345-0@lo:502: Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.244182:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789185561.244469:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8461:1876096898326528:0@lo:502: 00000040:00080000:2.0:1789185561.244491:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789185561.244826:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789185561.244853:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789185561.244863:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.244875:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185561.244885:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789185561.244888:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f30030e800 from 5 10000000:01000000:0.0:1789185561.244891:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789185561.244984:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.244999:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.245010:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185561.245026:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326656:0@lo:101: 00000100:00100000:0.0:1789185561.245065:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.245089:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.247158:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898326656 00000100:00100000:2.0:1789185561.247171:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898326656 00000100:00100000:2.0:1789185561.248175:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789185561.248189:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898326656:12345-0@lo:101: 00010000:00010000:2.0:1789185561.248220:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185561.248238:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72b86 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.248264:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72b86 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.248275:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b86 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.248284:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf400, rc 0) 00000100:00100000:2.0:1789185561.248353:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898326656:12345-0@lo:101: Request processed in 167us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.248360:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789185561.248424:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326656:0@lo:101: 00010000:00010000:2.0:1789185561.248443:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.248453:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.248512:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326784:0@lo:256: 00000100:00100000:2.0:1789185561.248547:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.248574:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.248592:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898326784 00000100:00100000:2.0:1789185561.248605:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898326784 00000100:00100000:2.0:1789185561.248633:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789185561.248642:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898326784:12345-0@lo:256: 20000000:01000000:2.0:1789185561.248657:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789185561.248672:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789185561.248675:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789185561.248763:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898326784:12345-0@lo:256: Request processed in 122us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.248771:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789185561.248808:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326784:0@lo:256: 10000000:01000000:2.0:1789185561.248849:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789185561.248856:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.248864:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.248873:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789185561.248875:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1789185561.248878:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789185561.248895:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.248902:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.248931:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.248942:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326912:0@lo:101: 00000100:00100000:2.0:1789185561.248972:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.248990:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.249001:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898326912 00000100:00100000:2.0:1789185561.249005:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898326912 00000100:00100000:2.0:1789185561.249029:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789185561.249037:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898326912:12345-0@lo:101: 00010000:00010000:2.0:1789185561.249044:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185561.249054:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72b94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.249069:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72b94 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.249079:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b94 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.249086:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddee00, rc 0) 00000100:00100000:2.0:1789185561.249118:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898326912:12345-0@lo:101: Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.249125:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789185561.249152:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898326912:0@lo:101: 00010000:00010000:2.0:1789185561.249161:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.249168:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.249215:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327040:0@lo:501: 00000100:00100000:2.0:1789185561.249245:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.249256:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.249266:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898327040 00000100:00100000:2.0:1789185561.249270:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898327040 00000100:00100000:2.0:1789185561.249290:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789185561.249296:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898327040:12345-0@lo:501: 00000100:00100000:2.0:1789185561.249411:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898327040:12345-0@lo:501: Request processed in 114us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.249417:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789185561.249446:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327040:0@lo:501: 00000100:00100000:2.0:1789185561.249469:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327168:0@lo:503: 00000100:00100000:2.0:1789185561.249508:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.249522:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018240 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.249532:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898327168 00000100:00100000:2.0:1789185561.249535:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898327168 00000100:00100000:2.0:1789185561.249553:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789185561.249558:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898327168:12345-0@lo:503: 00000100:00100000:2.0:1789185561.249648:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898327168:12345-0@lo:503: Request processed in 88us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.249655:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789185561.249703:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327168:0@lo:503: 00000100:00100000:0.0:1789185561.250750:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8462:1876096898327296:0@lo:502: 00000100:00100000:0.0:1789185561.250808:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.250882:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75ad780 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.251935:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898327296 00000100:00100000:2.0:1789185561.251944:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898327296 00000100:00100000:2.0:1789185561.251994:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789185561.252003:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:8462:x1876096898327296:12345-0@lo:502: 00000100:00100000:2.0:1789185561.252185:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:8462:x1876096898327296:12345-0@lo:502: Request processed in 183us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.252310:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789185561.252427:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8462:1876096898327296:0@lo:502: 00000020:01000000:0.0:1789185561.252456:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789185561.252463:0:8462:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789185561.252470:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185561.252472:0:8462:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789185561.252478:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789185561.252482:0:8462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:01000000:0.0:1789185561.252506:0:8462:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789185561.252509:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789185561.252524:0:8462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98f2f27a19c0) 00000020:00000080:0.0:1789185561.252546:0:8462:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1789185561.252552:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789185561.252653:0:8462:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789185561.252659:0:8462:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789185561.252669:0:8462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a72ba9 00010000:00080000:0.0:1789185561.252708:0:8462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f300f06000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.148@tcp at head 00010000:00010000:0.0:1789185561.252975:0:8462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789185561.272533:0:8462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789185561.272559:0:8462:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789185561.272894:0:8462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185561.273152:0:8462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185561.273243:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789185561.273332:0:8462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789185561.277359:0:8464:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185561.277366:0:8464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789185561.279458:0:8462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789185561.279472:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789185561.279513:0:8462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789185561.279537:0:8462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a72bb0 00000100:00080000:2.0:1789185561.279548:0:8462:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789185561.279559:0:8462:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f300f06000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:2.0:1789185561.279596:0:8462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758d880 x1876096898327424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789185561.280628:0:8462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789185561.280776:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898327424:0@lo:8: 00000100:00100000:3.0:1789185561.280849:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789185561.281108:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185561.281114:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185561.281116:0:8462:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789185561.281120:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185561.281125:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185561.281126:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789185561.281130:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789185561.281132:0:8462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789185561.281165:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8462:1876096898327552:0@lo:502: 00000100:00100000:2.0:1789185561.281213:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.281243:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898327552 00000100:00100000:2.0:1789185561.281250:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898327552 00000100:00100000:2.0:1789185561.281290:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789185561.281299:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:8462:x1876096898327552:12345-0@lo:502: 00000100:00100000:2.0:1789185561.281415:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:8462:x1876096898327552:12345-0@lo:502: Request processed in 117us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.281422:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789185561.281466:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.281495:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8462:1876096898327552:0@lo:502: 00000020:01000000:2.0:1789185561.281519:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1789185561.281521:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898327424 00000020:00000080:2.0:1789185561.281524:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185561.281527:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000100:00100000:1.0:1789185561.281529:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898327424 00000040:00080000:2.0:1789185561.281531:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1789185561.281556:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185561.281564:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898327424:12345-0@lo:8: 00000020:01000000:2.0:1789185561.281581:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 00010000:00080000:1.0:1789185561.281590:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 10000000:01000000:2.0:1789185561.281610:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000020:00000080:1.0:1789185561.281618:0:8427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a72bb7 00002000:00100000:1.0:1789185561.281655:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98f301c21000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789185561.281661:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1789185561.281665:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789185561.281717:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789185561.281940:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789185561.281964:0:8427:0:(import.c:65:import_set_state_nolock()) ffff98f301c24000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185561.282024:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876096898327424:12345-0@lo:8: Request processed in 460us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.282036:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789185561.282073:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f2f758d880 x1876096898327424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185561.282084:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185561.282091:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789185561.282098:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789185561.282103:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789185561.282105:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f300f06000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789185561.282112:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789185561.282117:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898327424:0@lo:8: 00010000:00010000:2.0:1789185561.283769:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.283789:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.283801:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789185561.283804:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2e7ae1000 from 30 10000000:01000000:2.0:1789185561.283808:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789185561.283844:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.283853:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.283865:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.283886:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327680:0@lo:101: 00000100:00100000:2.0:1789185561.283961:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.283989:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.284016:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898327680 00000100:00100000:2.0:1789185561.284022:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898327680 00000100:00100000:2.0:1789185561.284079:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789185561.284087:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898327680:12345-0@lo:101: 00010000:00010000:2.0:1789185561.284099:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185561.284110:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72bbe expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.284132:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72bbe expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.284141:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72bbe expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.284149:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf600, rc 0) 00000100:00100000:2.0:1789185561.284181:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898327680:12345-0@lo:101: Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.284187:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789185561.284231:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327680:0@lo:101: 00010000:00010000:2.0:1789185561.284243:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.284252:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.284299:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327808:0@lo:501: 00000100:00100000:2.0:1789185561.284325:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.284342:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.284359:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898327808 00000100:00100000:2.0:1789185561.284363:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898327808 00000100:00100000:2.0:1789185561.284384:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789185561.284410:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898327808:12345-0@lo:501: 00000100:00100000:2.0:1789185561.284509:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898327808:12345-0@lo:501: Request processed in 100us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.284516:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789185561.284544:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327808:0@lo:501: 00000100:00100000:2.0:1789185561.284566:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327936:0@lo:503: 00000100:00100000:2.0:1789185561.284601:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.284613:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.284623:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898327936 00000100:00100000:2.0:1789185561.284626:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898327936 00000004:00080000:3.0:1789185561.284782:0:8464:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789185561.284842:0:8464:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 200446933925ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789185561.284849:0:8464:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789185561.284903:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8466:1876096898328064:0@lo:700: 00000100:00100000:3.0:1789185561.284957:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.285000:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898328064 00000100:00100000:3.0:1789185561.285004:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898328064 00000100:00100000:3.0:1789185561.285048:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185561.285055:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8466:x1876096898328064:12345-0@lo:700: 00000100:00100000:3.0:1789185561.285083:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8436:1876096898328192:0@lo:700: 00000100:00100000:3.0:1789185561.285118:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.285134:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22aa240 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.285143:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22aacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.285245:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898328192 00000100:00100000:1.0:1789185561.285251:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898328192 00000100:00100000:1.0:1789185561.285287:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185561.285294:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8436:x1876096898328192:12345-0@lo:700: 00000100:00100000:2.0:1789185561.286209:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789185561.286220:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898327936:12345-0@lo:503: 00000100:00100000:2.0:1789185561.286331:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898327936:12345-0@lo:503: Request processed in 113us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.286338:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1789185561.287401:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185561.287409:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185561.288604:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898327936:0@lo:503: 00000100:00100000:2.0:1789185561.293994:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8467:1876096898328320:0@lo:502: 00000100:00100000:2.0:1789185561.294079:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.294125:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.294140:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898328320 00000100:00100000:0.0:1789185561.294151:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898328320 00000100:00100000:0.0:1789185561.294217:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789185561.294227:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:8467:x1876096898328320:12345-0@lo:502: 00000100:00100000:0.0:1789185561.294354:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:8467:x1876096898328320:12345-0@lo:502: Request processed in 128us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.294363:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000004:00080000:1.0:1789185561.294559:0:7444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789185561.294943:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8467:1876096898328320:0@lo:502: 00000100:00100000:2.0:1789185561.294999:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8467:1876096898328448:0@lo:502: 00000100:00100000:2.0:1789185561.295039:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.295064:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.295158:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898328448 00000100:00100000:3.0:1789185561.295164:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898328448 00000100:00100000:3.0:1789185561.295198:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789185561.295206:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:8467:x1876096898328448:12345-0@lo:502: 00000100:00100000:3.0:1789185561.295317:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:8467:x1876096898328448:12345-0@lo:502: Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.295325:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789185561.295583:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8467:1876096898328448:0@lo:502: 40000000:02000000:0.0:1789185561.295595:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:00080000:2.0:1789185561.295612:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789185561.295993:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789185561.296013:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789185561.296023:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.296034:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185561.296044:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789185561.296046:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f2e7ae1000 from 5 10000000:01000000:3.0:1789185561.296050:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185561.296075:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.296094:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185561.296104:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185561.296118:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898328576:0@lo:101: 00000100:00100000:3.0:1789185561.296152:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.296181:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22aad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.296222:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898328576 00000100:00100000:2.0:1789185561.296226:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898328576 00000100:00100000:2.0:1789185561.296260:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789185561.296276:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898328576:12345-0@lo:101: 00010000:00010000:2.0:1789185561.296286:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185561.296299:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72bcc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.296319:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72bcc expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.296329:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72bcc expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.296337:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde800, rc 0) 00000100:00100000:2.0:1789185561.296372:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898328576:12345-0@lo:101: Request processed in 97us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.296378:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789185561.296420:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898328576:0@lo:101: 00010000:00010000:2.0:1789185561.296633:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.296643:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.296753:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898328704:0@lo:256: 00000100:00100000:2.0:1789185561.296784:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.296806:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.296825:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898328704 00000100:00100000:2.0:1789185561.296829:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898328704 00000100:00100000:2.0:1789185561.296851:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789185561.296858:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898328704:12345-0@lo:256: 20000000:01000000:2.0:1789185561.296871:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789185561.296886:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789185561.296890:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789185561.296986:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898328704:12345-0@lo:256: Request processed in 128us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.296993:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789185561.297022:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898328704:0@lo:256: 10000000:01000000:2.0:1789185561.297066:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789185561.297072:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.297078:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185561.297086:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789185561.297088:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789185561.297090:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789185561.297106:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.297114:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.297121:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.297143:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898328832:0@lo:101: 00000100:00100000:2.0:1789185561.297167:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.297192:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7a9aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.297206:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898328832 00000100:00100000:2.0:1789185561.297209:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898328832 00000100:00100000:2.0:1789185561.297232:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789185561.297238:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898328832:12345-0@lo:101: 00010000:00010000:2.0:1789185561.297245:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185561.297253:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72bda expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.297285:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72bda expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.297294:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72bda expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.297302:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf800, rc 0) 00000100:00100000:2.0:1789185561.297329:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898328832:12345-0@lo:101: Request processed in 92us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.297336:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789185561.297363:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898328832:0@lo:101: 00010000:00010000:2.0:1789185561.297374:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185561.297382:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185561.298567:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898328960:0@lo:501: 00000100:00100000:2.0:1789185561.298608:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.298632:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7a9aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.298787:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898328960 00000100:00100000:3.0:1789185561.298793:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898328960 00000100:00100000:3.0:1789185561.298835:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789185561.298843:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898328960:12345-0@lo:501: 00000100:00100000:3.0:1789185561.298987:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898328960:12345-0@lo:501: Request processed in 145us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.298995:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789185561.299983:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898328960:0@lo:501: 00000100:00100000:2.0:1789185561.300025:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898329088:0@lo:503: 00000100:00100000:2.0:1789185561.300074:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.300106:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7a9aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.300170:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898329088 00000100:00100000:3.0:1789185561.300175:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898329088 00000100:00100000:3.0:1789185561.300217:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789185561.300225:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898329088:12345-0@lo:503: 00000100:00100000:3.0:1789185561.300329:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898329088:12345-0@lo:503: Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.300337:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789185561.300541:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898329088:0@lo:503: 00000100:00100000:2.0:1789185561.300948:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8469:1876096898329216:0@lo:502: 00000100:00100000:2.0:1789185561.300985:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185561.301009:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300380900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.301063:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898329216 00000100:00100000:3.0:1789185561.301068:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898329216 00000100:00100000:3.0:1789185561.301103:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789185561.301111:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+20:8469:x1876096898329216:12345-0@lo:502: 00000100:00100000:3.0:1789185561.301191:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+20:8469:x1876096898329216:12345-0@lo:502: Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.301198:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789185561.301279:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8469:1876096898329216:0@lo:502: 00000020:01000000:2.0:1789185561.301300:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789185561.301307:0:8469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789185561.301313:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185561.301315:0:8469:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789185561.301320:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789185561.301324:0:8469:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:01000000:2.0:1789185561.301344:0:8469:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789185561.301347:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185561.301361:0:8469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98f300180000) 00000020:00000080:2.0:1789185561.301381:0:8469:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1789185561.301386:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789185561.301482:0:8469:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789185561.301488:0:8469:0:(osd_handler.c:8926:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789185561.301499:0:8469:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a72bef 00010000:00080000:2.0:1789185561.301526:0:8469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f300ec3800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.148@tcp at head 00010000:00010000:2.0:1789185561.301764:0:8469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1789185561.305069:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8436:x1876096898328192:12345-0@lo:700: Request processed in 19767us (19941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.305089:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789185561.305563:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c19b5c00 x1876096898328192/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185561.305580:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8436:1876096898328192:0@lo:700: 40000000:02000000:3.0:1789185561.305593:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1789185561.315408:0:8469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789185561.315448:0:8469:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789185561.315667:0:8469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185561.315856:0:8469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185561.315978:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789185561.316063:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789185561.316595:0:8471:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185561.316601:0:8471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789185561.317167:0:8469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789185561.317178:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789185561.317215:0:8469:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789185561.317239:0:8469:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a72bf6 00000100:00080000:0.0:1789185561.317249:0:8469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789185561.317260:0:8469:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f300ec3800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185561.317294:0:8469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b0700 x1876096898329344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185561.317321:0:8469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789185561.317386:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185561.317404:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185561.317406:0:8469:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789185561.317410:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185561.317414:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185561.317416:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789185561.317419:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789185561.317420:0:8469:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789185561.317571:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8469:1876096898329472:0@lo:502: 00000100:00100000:0.0:1789185561.317644:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.317685:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f2789000 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.317747:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898329344:0@lo:8: 00000100:00100000:1.0:1789185561.317782:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.317862:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898329344 00000100:00100000:0.0:1789185561.317869:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898329344 00000100:00100000:0.0:1789185561.317923:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185561.317930:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1876096898329344:12345-0@lo:8: 00010000:00080000:0.0:1789185561.317954:0:8430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1789185561.317979:0:8430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a72bfd 00002000:00100000:0.0:1789185561.317991:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98f300ec4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789185561.317995:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789185561.317998:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789185561.318059:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789185561.318081:0:8430:0:(import.c:65:import_set_state_nolock()) ffff98f300ec2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185561.318127:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1876096898329344:12345-0@lo:8: Request processed in 195us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.318134:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789185561.318555:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b0700 x1876096898329344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185561.318566:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185561.318572:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789185561.318579:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789185561.318584:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789185561.318586:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f300ec3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789185561.318608:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789185561.318613:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898329344:0@lo:8: 00000004:00080000:0.0:1789185561.319040:0:8471:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789185561.319090:0:8471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200481181669ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789185561.319097:0:8471:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789185561.319382:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898329472 00000100:00100000:2.0:1789185561.319389:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898329472 00000100:00100000:2.0:1789185561.319448:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789185561.319457:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:8469:x1876096898329472:12345-0@lo:502: 00000100:00100000:2.0:1789185561.319595:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:8469:x1876096898329472:12345-0@lo:502: Request processed in 139us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.319601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789185561.319778:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:8469:1876096898329472:0@lo:502: 00000020:01000000:0.0:1789185561.319810:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185561.319816:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185561.319818:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789185561.319823:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789185561.320168:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789185561.320196:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789185561.320208:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.320220:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185561.320232:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789185561.320235:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98f2c6fd4d40 from 1 10000000:01000000:1.0:1789185561.320238:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789185561.320269:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.320278:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.320287:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185561.320306:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898329600:0@lo:101: 00000100:00100000:1.0:1789185561.320344:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185561.320366:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f0f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185561.320381:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898329600 00000100:00100000:1.0:1789185561.320386:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898329600 00000100:00100000:1.0:1789185561.320971:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789185561.320979:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898329600:12345-0@lo:101: 00010000:00010000:1.0:1789185561.320990:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185561.321002:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72c04 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.321031:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72c04 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.321041:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c04 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185561.321050:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166c800, rc 0) 00000100:00100000:1.0:1789185561.321131:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898329600:12345-0@lo:101: Request processed in 153us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.321138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789185561.325565:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898329600:0@lo:101: 00010000:00010000:0.0:1789185561.325593:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.325606:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185561.325715:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898329728:0@lo:501: 00000100:00100000:0.0:1789185561.325773:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.325809:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f2789000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.325867:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898329728 00000100:00100000:2.0:1789185561.325875:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898329728 00000100:00100000:2.0:1789185561.325993:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789185561.326002:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898329728:12345-0@lo:501: 00000100:00100000:2.0:1789185561.326095:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898329728:12345-0@lo:501: Request processed in 94us (321us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185561.326103:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789185561.326178:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898329728:0@lo:501: 10000000:01000000:0.0:1789185561.326208:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789185561.326215:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185561.326225:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789185561.329095:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789185561.329185:0:8472:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789185561.329213:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8472:1876096898329984:0@lo:7: 00000100:00100000:0.0:1789185561.329289:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.329322:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f2789000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185561.329610:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898329856:0@lo:13: 00000100:00100000:2.0:1789185561.329655:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1789185561.329767:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789185561.329775:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789185561.329812:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898329856 00000100:00100000:0.0:1789185561.329823:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898329856 00000100:00100000:2.0:1789185561.329846:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8466:x1876096898328064:12345-0@lo:700: Request processed in 44790us (44887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185561.329861:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185561.329878:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185561.329888:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898329856:12345-0@lo:13: 00002000:00000024:0.0:1789185561.329927:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1789185561.329971:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898329856:12345-0@lo:13: Request processed in 84us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.329979:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789185561.329996:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185561.330140:0:8466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b7480 x1876096898328064/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185561.330155:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8466:1876096898328064:0@lo:700: 00010000:00080000:2.0:1789185561.330256:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b2300 x1876096898329856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185561.330273:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898329856:0@lo:13: 00000100:00100000:3.0:1789185561.330336:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898329984 00000100:00100000:3.0:1789185561.330340:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898329984 00000100:00100000:3.0:1789185561.330608:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185561.330618:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8472:x1876096898329984:12345-0@lo:7: 00002000:00080000:3.0:1789185561.337666:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789185561.337674:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789185561.337927:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8472:x1876096898329984:12345-0@lo:7: Request processed in 7290us (8617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.337938:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789185561.338003:0:8472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b2d80 x1876096898329984/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185561.338017:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8472:1876096898329984:0@lo:7: 00000004:00080000:3.0:1789185561.338030:0:8472:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789185561.338070:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8472:1876096898330112:0@lo:5: 00000100:00100000:3.0:1789185561.338103:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.338132:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898330112 00000100:00100000:3.0:1789185561.338137:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898330112 00000100:00100000:3.0:1789185561.338172:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185561.338326:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8472:x1876096898330112:12345-0@lo:5: 00002000:00080000:3.0:1789185561.338359:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789185561.338363:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789185561.338692:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8472:x1876096898330112:12345-0@lo:5: Request processed in 369us (587us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789185561.338699:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185561.338875:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22aa600 going to sleep for 11 seconds 00010000:00080000:3.0:1789185561.338892:0:8472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b5c00 x1876096898330112/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185561.338903:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8472:1876096898330112:0@lo:5: 00000004:00080000:3.0:1789185561.338945:0:8472:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789185561.338969:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8472:1876096898330240:0@lo:700: 00000100:00100000:3.0:1789185561.338994:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.339018:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898330240 00000100:00100000:3.0:1789185561.339022:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898330240 00000100:00100000:3.0:1789185561.339047:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185561.339053:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8472:x1876096898330240:12345-0@lo:700: 00000100:00100000:3.0:1789185561.339126:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22aa600 going to sleep for 11 seconds 00000004:00080000:0.0:1789185561.351045:0:8466:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789185561.351148:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8466:1876096898330496:0@lo:7: 00000100:00100000:0.0:1789185561.351220:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.351261:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f27893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.351280:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898330496 00000100:00100000:0.0:1789185561.351288:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898330496 00000100:00100000:0.0:1789185561.351335:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185561.351344:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8466:x1876096898330496:12345-0@lo:7: 00000100:00100000:2.0:1789185561.353995:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898330368:0@lo:13: 00000100:00100000:2.0:1789185561.354266:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.356968:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898330368 00000100:00100000:0.0:1789185561.356981:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898330368 00000100:00100000:0.0:1789185561.357031:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185561.357041:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898330368:12345-0@lo:13: 00002000:00000024:0.0:1789185561.357144:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1789185561.357215:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898330368:12345-0@lo:13: Request processed in 176us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.357222:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789185561.358466:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b1180 x1876096898330368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185561.358492:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898330368:0@lo:13: 00000001:00080000:1.0:1789185561.362509:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1789185561.362878:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8472:x1876096898330240:12345-0@lo:700: Request processed in 23818us (23876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185561.362896:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789185561.363196:0:8472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b4e00 x1876096898330240/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185561.363208:0:8472:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789185561.363226:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8472:1876096898330240:0@lo:700: 00000004:02000040:1.0:1789185561.365181:0:8472:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00002000:00080000:0.0:1789185561.369004:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789185561.369014:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789185561.369105:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8466:x1876096898330496:12345-0@lo:7: Request processed in 17758us (17881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.369122:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789185561.369835:0:8466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b2a00 x1876096898330496/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185561.369853:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8466:1876096898330496:0@lo:7: 00000004:00080000:0.0:1789185561.369869:0:8466:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789185561.369948:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8466:1876096898330624:0@lo:5: 00000100:00100000:0.0:1789185561.369988:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185561.370019:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898330624 00000100:00100000:3.0:1789185561.370028:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898330624 00000100:00100000:0.0:1789185561.370029:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f27893c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185561.370076:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185561.370088:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8466:x1876096898330624:12345-0@lo:5: 00002000:00080000:3.0:1789185561.370185:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789185561.370233:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8466:x1876096898330624:12345-0@lo:5: Request processed in 148us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185561.370240:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789185561.370543:0:8466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b2a00 x1876096898330624/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185561.370554:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8466:1876096898330624:0@lo:5: 00000004:00080000:0.0:1789185561.370563:0:8466:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789185561.370589:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8466:1876096898330752:0@lo:5: 00000100:00100000:0.0:1789185561.370617:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.370639:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f27893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.370653:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898330752 00000100:00100000:0.0:1789185561.370657:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898330752 00000100:00100000:0.0:1789185561.370688:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185561.370696:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8466:x1876096898330752:12345-0@lo:5: 00002000:00080000:0.0:1789185561.370722:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789185561.372603:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8466:x1876096898330752:12345-0@lo:5: Request processed in 1901us (1980us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789185561.372624:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789185561.372716:0:8466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f1c19b2a00 x1876096898330752/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185561.372732:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8466:1876096898330752:0@lo:5: 00000100:00100000:1.0:1789185561.372738:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8472:1876096898330880:0@lo:5: 00000004:00080000:0.0:1789185561.372748:0:8466:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789185561.372779:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8466:1876096898331008:0@lo:900: 00000100:00100000:1.0:1789185561.372786:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185561.372819:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185561.372825:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898330880 00000100:00100000:1.0:1789185561.372839:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898330880 00000100:00100000:0.0:1789185561.372843:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f27893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185561.372871:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898331008 00000100:00100000:0.0:1789185561.372876:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898331008 00000100:00100000:0.0:1789185561.372937:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185561.372947:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8466:x1876096898331008:12345-0@lo:900: 00000100:00100000:0.0:1789185561.372988:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8466:x1876096898331008:12345-0@lo:900: Request processed in 43us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185561.372994:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789185561.373019:0:8466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c19b3800 x1876096898331008/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185561.373028:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8466:1876096898331008:0@lo:900: 00000100:00100000:1.0:1789185561.373519:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185561.373529:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8472:x1876096898330880:12345-0@lo:5: 00000100:00100000:0.0:1789185561.375972:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f0f9c0 going to sleep for 11 seconds 00002000:00080000:1.0:1789185561.380664:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789185561.380686:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1789185561.382967:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8472:x1876096898330880:12345-0@lo:5: Request processed in 9432us (10177us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789185561.382980:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789185561.383114:0:8472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98f300253480 x1876096898330880/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185577 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185561.383133:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8472:1876096898330880:0@lo:5: 00000004:00080000:0.0:1789185561.383150:0:8472:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1789185561.897315:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789185561.939285:0:8513:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185561.939528:0:8513:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789185562.918589:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185563.947176:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185564.070803:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898331136:0@lo:41: 00000100:00100000:2.0:1789185564.071069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185564.071246:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898331136 00000100:00100000:1.0:1789185564.071257:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898331136 00000100:00100000:1.0:1789185564.071324:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789185564.071336:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898331136:12345-0@lo:41: 00000004:00000024:1.0:1789185564.071396:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789185564.071468:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898331136:12345-0@lo:41: Request processed in 133us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185564.071475:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185564.071557:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898331136:0@lo:41: 00010000:00010000:1.0:1789185564.970033:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185565.609604:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185565.609629:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898331264:0@lo:41: 00000100:00100000:3.0:1789185565.609700:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185565.609818:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898331264 00000100:00100000:3.0:1789185565.609826:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898331264 00000100:00100000:3.0:1789185565.609876:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789185565.609884:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898331264:12345-0@lo:41: 00000004:00000024:3.0:1789185565.609939:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789185565.609987:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898331264:12345-0@lo:41: Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185565.609995:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789185565.610042:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898331264:0@lo:41: 00010000:00010000:0.0:1789185565.990044:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185566.630207:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898331392:0@lo:13: 00000100:00100000:3.0:1789185566.630287:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185566.630367:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898331904:0@lo:400: 00000100:00100000:3.0:1789185566.630428:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185566.630450:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898332416:0@lo:400: 00000100:00100000:3.0:1789185566.630480:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185566.630506:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789185566.630512:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898331776:0@lo:400: 00000100:00100000:3.0:1789185566.630533:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185566.630549:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898332288:0@lo:400: 00000100:00100000:3.0:1789185566.630569:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185566.630603:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898331520:0@lo:13: 00000100:00100000:3.0:1789185566.630641:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185566.630682:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898332032:0@lo:400: 00000100:00100000:3.0:1789185566.630706:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185566.630725:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898332544:0@lo:400: 00000100:00100000:3.0:1789185566.630759:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185566.631059:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898331392 00000100:00100000:2.0:1789185566.631068:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898331392 00000100:00100000:2.0:1789185566.631133:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898331520 00000100:00100000:2.0:1789185566.631137:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898331520 00000100:00100000:2.0:1789185566.631159:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185566.631170:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876096898331392:12345-0@lo:13: 00002000:00000024:2.0:1789185566.631205:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185566.631262:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876096898331392:12345-0@lo:13: Request processed in 95us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185566.631270:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185566.631305:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185566.631314:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898331520:12345-0@lo:13: 00002000:00000024:2.0:1789185566.631326:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185566.631359:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898331520:12345-0@lo:13: Request processed in 47us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185566.631366:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789185566.631390:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789185566.632598:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b6d80 x1876096898331520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185566.632624:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898331520:0@lo:13: 00000100:00100000:3.0:1789185566.632640:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789185566.632660:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898331648:0@lo:400: 00000100:00100000:3.0:1789185566.632707:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185566.632725:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898332416 00000100:00100000:1.0:1789185566.632734:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898332416 00000100:00100000:3.0:1789185566.632738:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898332160:0@lo:400: 00000100:00100000:1.0:1789185566.632777:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898331776 00000100:00100000:1.0:1789185566.632781:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898331776 00000100:00100000:1.0:1789185566.632797:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898332288 00000100:00100000:1.0:1789185566.632800:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898332288 00000100:00100000:1.0:1789185566.632813:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898332032 00000100:00100000:1.0:1789185566.632816:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898332032 00000100:00100000:1.0:1789185566.632831:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185566.632839:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898332416:12345-0@lo:400: 00000100:00100000:1.0:1789185566.632892:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898332416:12345-0@lo:400: Request processed in 53us (2409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.632933:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185566.632951:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185566.632958:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898331776:12345-0@lo:400: 00000100:00100000:1.0:1789185566.632990:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898331776:12345-0@lo:400: Request processed in 33us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.632997:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789185566.633012:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185566.633013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789185566.633017:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185566.633025:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898332288:12345-0@lo:400: 00000100:00100000:1.0:1789185566.633056:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898332288:12345-0@lo:400: Request processed in 34us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.633062:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185566.633074:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185566.633080:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898332032:12345-0@lo:400: 00000100:00100000:1.0:1789185566.633109:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898332032:12345-0@lo:400: Request processed in 30us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.633115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185566.633141:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898331648 00000100:00100000:1.0:1789185566.633145:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898331648 00000100:00100000:1.0:1789185566.633183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789185566.633191:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3637:x1876096898331648:12345-0@lo:400: 00000100:00100000:1.0:1789185566.633222:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3637:x1876096898331648:12345-0@lo:400: Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185566.633228:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789185566.634492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185566.634541:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898332672:0@lo:400: 00000100:00100000:3.0:1789185566.634608:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789185566.634664:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b4000 x1876096898332032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185566.634679:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898332032:0@lo:400: 00000100:00100000:3.0:1789185566.634704:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898331648:0@lo:400: 00000100:00100000:3.0:1789185566.634741:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898331904 00000100:00100000:3.0:1789185566.634747:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898331904 00000100:00100000:0.0:1789185566.636164:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898332544 00000100:00100000:0.0:1789185566.636175:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898332544 00000100:00100000:0.0:1789185566.639470:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898332672 00000100:00100000:0.0:1789185566.639486:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898332672 00000100:00100000:0.0:1789185566.639662:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185566.639678:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898332544:12345-0@lo:400: 00000100:00100000:0.0:1789185566.639779:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898332544:12345-0@lo:400: Request processed in 106us (9018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185566.639787:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185566.639805:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185566.639811:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898332672:12345-0@lo:400: 00000100:00100000:0.0:1789185566.639843:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898332672:12345-0@lo:400: Request processed in 32us (5234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185566.639849:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789185566.639892:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b7b80 x1876096898332672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185566.639930:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898332672:0@lo:400: 00010000:00080000:0.0:1789185566.639947:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b5880 x1876096898332544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185566.639957:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898332544:0@lo:400: 00000100:00100000:3.0:1789185566.640487:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898332160 00000100:00100000:3.0:1789185566.640494:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898332160 00000100:00100000:3.0:1789185566.640517:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789185566.640525:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898331904:12345-0@lo:400: 00000100:00100000:3.0:1789185566.640574:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898331904:12345-0@lo:400: Request processed in 50us (10146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185566.640596:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789185566.640610:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789185566.640616:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898332160:12345-0@lo:400: 00000100:00100000:3.0:1789185566.640666:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898332160:12345-0@lo:400: Request processed in 51us (6180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185566.640672:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789185566.640736:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898332160:0@lo:400: 00010000:00080000:2.0:1789185566.647699:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b7480 x1876096898331776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185566.647719:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898331776:0@lo:400: 00010000:00080000:2.0:1789185566.647739:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b5180 x1876096898332288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185566.647748:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898332288:0@lo:400: 00010000:00080000:2.0:1789185566.647761:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f2f758ca80 x1876096898331392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185566.647780:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898331392:0@lo:13: 00000001:00080000:1.0:1789185566.649677:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1789185566.649696:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1789185566.650054:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898331904:0@lo:400: 00010000:00080000:2.0:1789185566.650106:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b5500 x1876096898332416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185566.650122:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898332416:0@lo:400: 00000001:02000400:2.0:1789185566.935849:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789185567.016495:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789185567.906465:0:8855:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185567.906690:0:8855:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789185568.041555:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185569.063516:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185569.190471:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185569.190497:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898332800:0@lo:41: 00000100:00100000:3.0:1789185569.190572:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185569.191897:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898332800 00000100:00100000:0.0:1789185569.191957:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898332800 00000100:00100000:0.0:1789185569.192023:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789185569.192033:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898332800:12345-0@lo:41: 00000004:00000024:0.0:1789185569.192069:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789185569.192199:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898332800:12345-0@lo:41: Request processed in 168us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185569.192207:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789185569.197087:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898332800:0@lo:41: 00010000:00010000:0.0:1789185570.086295:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185570.727064:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185570.727101:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898332928:0@lo:41: 00000100:00100000:3.0:1789185570.727191:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185570.727260:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898332928 00000100:00100000:0.0:1789185570.727270:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898332928 00000100:00100000:0.0:1789185570.727344:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789185570.727355:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898332928:12345-0@lo:41: 00000004:00000024:0.0:1789185570.727395:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789185570.727450:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898332928:12345-0@lo:41: Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185570.727457:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789185570.727521:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898332928:0@lo:41: 00000020:00000004:2.0:1789185570.875856:0:8956:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185570.876494:0:8956:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789185571.116099:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185571.750189:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898333056:0@lo:13: 00000100:00100000:3.0:1789185571.750540:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898333184:0@lo:13: 00000100:00100000:2.0:1789185571.750577:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185571.752491:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898333056 00000100:00100000:0.0:1789185571.752509:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898333056 00000100:00100000:0.0:1789185571.752596:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185571.752609:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898333056:12345-0@lo:13: 00002000:00000024:0.0:1789185571.752655:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789185571.753980:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185571.757593:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185571.757827:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898333696:0@lo:400: 00000100:00100000:3.0:1789185571.757905:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185571.757958:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789185571.757965:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898333568:0@lo:400: 00000100:00100000:3.0:1789185571.757994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185571.758014:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898334080:0@lo:400: 00000100:00100000:3.0:1789185571.758034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185571.758082:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898333696 00000100:00100000:3.0:1789185571.758092:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898333696 00000100:00100000:3.0:1789185571.758145:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898334080 00000100:00100000:3.0:1789185571.758156:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898334080 00000100:00100000:3.0:1789185571.758192:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789185571.758306:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789185571.758318:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789185571.758437:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898333696:12345-0@lo:400: 00000100:00100000:3.0:1789185571.758513:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898333696:12345-0@lo:400: Request processed in 141us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185571.760774:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898333312:0@lo:400: 00000100:00100000:0.0:1789185571.760859:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185571.760944:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898333824:0@lo:400: 00000100:00100000:0.0:1789185571.760978:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185571.761012:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789185571.761029:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898333440:0@lo:400: 00000100:00100000:0.0:1789185571.761129:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185571.761144:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898333952:0@lo:400: 00000100:00100000:0.0:1789185571.761261:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185571.761373:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898333568 00000100:00100000:0.0:1789185571.761441:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898333568 00000100:00100000:0.0:1789185571.761498:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898333824 00000100:00100000:0.0:1789185571.761502:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898333824 00000100:00100000:0.0:1789185571.761520:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789185571.761530:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898333568:12345-0@lo:400: 00000100:00100000:0.0:1789185571.761596:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898333568:12345-0@lo:400: Request processed in 68us (3601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185571.761604:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789185571.761624:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789185571.761629:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898333824:12345-0@lo:400: 00000100:00100000:0.0:1789185571.761659:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898333824:12345-0@lo:400: Request processed in 30us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185571.761665:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789185571.761705:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898333824:0@lo:400: 00000100:00100000:0.0:1789185571.761757:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898333056:12345-0@lo:13: Request processed in 9152us (11181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185571.761766:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789185571.761804:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f2f758ca80 x1876096898333056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185571.761816:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789185571.761837:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898333056:0@lo:13: 00000100:00100000:0.0:1789185571.761868:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898333184 00000100:00100000:0.0:1789185571.761873:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898333184 00000100:00100000:0.0:1789185571.761898:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185571.761905:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898333184:12345-0@lo:13: 00002000:00000024:0.0:1789185571.761959:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185571.761993:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898333184:12345-0@lo:13: Request processed in 89us (4700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185571.761999:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185571.762164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898333312 00000100:00100000:1.0:1789185571.762169:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898333312 00000100:00100000:1.0:1789185571.762215:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789185571.762223:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3635:x1876096898333312:12345-0@lo:400: 00000100:00100000:1.0:1789185571.762271:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3635:x1876096898333312:12345-0@lo:400: Request processed in 49us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185571.762277:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789185571.762479:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185571.762499:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898334080:12345-0@lo:400: 00000100:00100000:2.0:1789185571.762541:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898334080:12345-0@lo:400: Request processed in 47us (4505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185571.762548:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185571.762564:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898333440 00000100:00100000:2.0:1789185571.762568:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898333440 00000100:00100000:2.0:1789185571.762585:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898333952 00000100:00100000:2.0:1789185571.762588:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898333952 00000100:00100000:2.0:1789185571.762604:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185571.762610:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898333440:12345-0@lo:400: 00000100:00100000:2.0:1789185571.762638:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898333440:12345-0@lo:400: Request processed in 28us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185571.762644:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185571.762656:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789185571.762662:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898333952:12345-0@lo:400: 00000100:00100000:2.0:1789185571.762684:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898333952:12345-0@lo:400: Request processed in 23us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185571.762690:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789185571.762977:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789185571.763007:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185571.763012:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789185571.763015:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185571.763057:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898333568:0@lo:400: 00010000:00080000:3.0:1789185571.763073:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2303100 x1876096898334080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185571.763085:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898334080:0@lo:400: 00010000:00080000:3.0:1789185571.763098:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2302a00 x1876096898333696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185571.763106:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898333696:0@lo:400: 00010000:00080000:3.0:1789185571.763118:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2300e00 x1876096898333184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185571.763126:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789185571.763142:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898333184:0@lo:13: 00010000:00080000:0.0:1789185571.763306:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2303b80 x1876096898333440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185571.763316:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898333440:0@lo:400: 00010000:00080000:0.0:1789185571.763326:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2301880 x1876096898333952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185571.763333:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898333952:0@lo:400: 00000100:00100000:0.0:1789185571.763341:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898333312:0@lo:400: 00000020:00000004:1.0:1789185571.898133:0:9005:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789185571.898148:0:9005:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789185572.136303:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185573.159124:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185574.184057:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185574.312049:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185574.312086:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898334208:0@lo:41: 00000100:00100000:1.0:1789185574.312193:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185574.312293:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898334208 00000100:00100000:1.0:1789185574.312305:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898334208 00000100:00100000:1.0:1789185574.312368:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789185574.312379:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898334208:12345-0@lo:41: 00000004:00000024:1.0:1789185574.312570:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789185574.312684:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898334208:12345-0@lo:41: Request processed in 306us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185574.312692:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789185574.317014:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898334208:0@lo:41: 00010000:00010000:1.0:1789185575.206173:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185575.847371:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185575.847418:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898334336:0@lo:41: 00000100:00100000:3.0:1789185575.847528:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185575.847621:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898334336 00000100:00100000:3.0:1789185575.847631:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898334336 00000100:00100000:3.0:1789185575.847692:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789185575.847709:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898334336:12345-0@lo:41: 00000004:00000024:3.0:1789185575.847761:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789185575.847819:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898334336:12345-0@lo:41: Request processed in 110us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185575.847828:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789185575.847888:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898334336:0@lo:41: 00010000:00010000:0.0:1789185576.234225:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185576.870682:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898334464:0@lo:13: 00000100:00100000:3.0:1789185576.870782:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185576.871325:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898334720:0@lo:400: 00000100:00100000:1.0:1789185576.871367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185576.871392:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898335232:0@lo:400: 00000100:00100000:1.0:1789185576.871801:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185576.871927:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898334592:0@lo:400: 00000100:00100000:3.0:1789185576.871974:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185576.872008:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898335104:0@lo:400: 00000100:00100000:3.0:1789185576.872041:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185576.872087:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898334592 00000100:00100000:3.0:1789185576.872109:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898334592 00000100:00100000:3.0:1789185576.872171:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789185576.872182:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3637:x1876096898334592:12345-0@lo:400: 00000100:00100000:3.0:1789185576.872250:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3637:x1876096898334592:12345-0@lo:400: Request processed in 69us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185576.872257:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789185576.872296:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898335104 00000100:00100000:3.0:1789185576.872300:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898335104 00000100:00100000:3.0:1789185576.872324:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789185576.872330:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898335104:12345-0@lo:400: 00000100:00100000:3.0:1789185576.872367:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898335104:12345-0@lo:400: Request processed in 36us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185576.872373:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789185576.872543:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898334464 00000100:00100000:0.0:1789185576.872549:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898334464 00000100:00100000:0.0:1789185576.872593:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185576.872601:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898334464:12345-0@lo:13: 00002000:00000024:0.0:1789185576.872640:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185576.872687:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898334464:12345-0@lo:13: Request processed in 88us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185576.872694:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789185576.872754:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185576.872943:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185576.872955:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898335616:0@lo:13: 00000100:00100000:1.0:1789185576.872988:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185576.873020:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898335616 00000100:00100000:2.0:1789185576.873026:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898335616 00000100:00100000:1.0:1789185576.873034:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898334720 00000100:00100000:1.0:1789185576.873040:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898334720 00000100:00100000:1.0:1789185576.873077:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898335232 00000100:00100000:1.0:1789185576.873080:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898335232 00000100:00100000:1.0:1789185576.873335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789185576.873345:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898334720:12345-0@lo:400: 00000100:00100000:1.0:1789185576.873391:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898334720:12345-0@lo:400: Request processed in 48us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185576.873409:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789185576.873424:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789185576.873431:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898335232:12345-0@lo:400: 00000100:00100000:1.0:1789185576.873459:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898335232:12345-0@lo:400: Request processed in 29us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185576.873465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789185576.873628:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185576.873632:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185576.873667:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185576.873678:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898335616:12345-0@lo:13: 00002000:00000024:2.0:1789185576.873695:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185576.873730:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898335616:12345-0@lo:13: Request processed in 55us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185576.873737:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789185576.873807:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b2d80 x1876096898335616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185576.873850:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898335616:0@lo:13: 00010000:00080000:1.0:1789185576.873869:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f300250e00 x1876096898334720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185576.873879:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898334720:0@lo:400: 00010000:00080000:1.0:1789185576.873892:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2c05f80 x1876096898335232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185576.873899:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898335232:0@lo:400: 00000100:00100000:3.0:1789185576.874186:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898334848:0@lo:400: 00000100:00100000:3.0:1789185576.874234:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185576.874355:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898335360:0@lo:400: 00000100:00100000:3.0:1789185576.874384:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185576.874748:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789185576.874758:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898334976:0@lo:400: 00000100:00100000:3.0:1789185576.874787:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185576.874810:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898335488:0@lo:400: 00000100:00100000:3.0:1789185576.874975:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185576.875029:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898334592:0@lo:400: 00000100:00100000:3.0:1789185576.875043:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898335104:0@lo:400: 00010000:00080000:3.0:1789185576.875082:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2300e00 x1876096898334464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185576.875112:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898334464:0@lo:13: 00000100:00100000:3.0:1789185576.875139:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898335360 00000100:00100000:3.0:1789185576.875145:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898335360 00000100:00100000:3.0:1789185576.875192:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898334976 00000100:00100000:3.0:1789185576.875195:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898334976 00000100:00100000:3.0:1789185576.875214:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185576.875223:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898335360:12345-0@lo:400: 00000100:00100000:3.0:1789185576.875271:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898335360:12345-0@lo:400: Request processed in 50us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185576.875278:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185576.875295:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185576.875302:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898334976:12345-0@lo:400: 00000100:00100000:3.0:1789185576.875340:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898334976:12345-0@lo:400: Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185576.875346:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789185576.875367:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789185576.875386:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f300253b80 x1876096898334976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185576.875395:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898334976:0@lo:400: 00010000:00080000:3.0:1789185576.876732:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2c04380 x1876096898335360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185576.876750:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898335360:0@lo:400: 00000100:00100000:3.0:1789185576.876831:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898335488 00000100:00100000:3.0:1789185576.876840:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898335488 00000100:00100000:3.0:1789185576.876899:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185576.878586:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898335488:12345-0@lo:400: 00000100:00100000:3.0:1789185576.879641:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898335488:12345-0@lo:400: Request processed in 2726us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185576.879659:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185576.880536:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898334848 00000100:00100000:0.0:1789185576.880552:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898334848 00000100:00100000:0.0:1789185576.881053:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185576.881065:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898334848:12345-0@lo:400: 00000100:00100000:0.0:1789185576.881182:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898334848:12345-0@lo:400: Request processed in 119us (6948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185576.881190:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789185576.882897:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2c06680 x1876096898335488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185576.882945:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898335488:0@lo:400: 00000100:00100000:1.0:1789185576.882964:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898334848:0@lo:400: 00010000:00010000:3.0:1789185577.254175:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185578.278220:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185579.304139:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185579.430382:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898335744:0@lo:41: 00000100:00100000:2.0:1789185579.430498:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185579.430655:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898335744 00000100:00100000:1.0:1789185579.430668:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898335744 00000100:00100000:1.0:1789185579.430749:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789185579.430763:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898335744:12345-0@lo:41: 00000004:00000024:1.0:1789185579.430817:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789185579.430874:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898335744:12345-0@lo:41: Request processed in 115us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185579.430881:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789185579.432319:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898335744:0@lo:41: 00010000:00010000:0.0:1789185580.330963:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185580.966718:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898335872:0@lo:41: 00000100:00100000:1.0:1789185580.966816:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185580.967531:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898335872 00000100:00100000:3.0:1789185580.967546:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898335872 00000100:00100000:3.0:1789185580.967622:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185580.967635:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898335872:12345-0@lo:41: 00000004:00000024:3.0:1789185580.967685:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789185580.967778:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898335872:12345-0@lo:41: Request processed in 146us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185580.967786:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789185580.967858:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898335872:0@lo:41: 00010000:00010000:0.0:1789185581.358100:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185581.990355:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898336000:0@lo:13: 00000100:00100000:1.0:1789185581.990461:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185581.990573:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898336000 00000100:00100000:1.0:1789185581.990586:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898336000 00000100:00100000:1.0:1789185581.990678:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789185581.991262:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185581.991341:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898336000:12345-0@lo:13: 00002000:00000024:1.0:1789185581.991385:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185581.991460:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898336000:12345-0@lo:13: Request processed in 127us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185581.993369:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185581.993399:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898336128:0@lo:13: 00000100:00100000:3.0:1789185581.993480:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185581.993553:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898336128 00000100:00100000:3.0:1789185581.993562:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898336128 00000100:00080000:0.0:1789185581.998890:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185582.000835:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789185582.001365:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2c07b80 x1876096898336000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185582.001400:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898336000:0@lo:13: 00000100:00100000:0.0:1789185582.001589:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898336640:0@lo:400: 00000100:00100000:0.0:1789185582.001677:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185582.002291:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898336384:0@lo:400: 00000100:00100000:1.0:1789185582.002355:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898336256:0@lo:400: 00000100:00100000:1.0:1789185582.002395:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185582.002443:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898336768:0@lo:400: 00000100:00100000:1.0:1789185582.002471:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185582.002513:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898336256 00000100:00100000:1.0:1789185582.002523:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898336256 00000100:00100000:1.0:1789185582.002581:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789185582.002591:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3638:x1876096898336256:12345-0@lo:400: 00000100:00100000:1.0:1789185582.002650:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3638:x1876096898336256:12345-0@lo:400: Request processed in 61us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.002658:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789185582.003497:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185582.003514:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898336128:12345-0@lo:13: 00002000:00000024:3.0:1789185582.003538:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185582.003625:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898336768 00000100:00100000:1.0:1789185582.003633:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898336768 00000100:00100000:1.0:1789185582.003671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185582.003678:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898336768:12345-0@lo:400: 00000100:00100000:1.0:1789185582.011337:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898336768:12345-0@lo:400: Request processed in 7644us (8849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.011358:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185582.011442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185582.011497:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898336896:0@lo:400: 00000100:00100000:0.0:1789185582.011733:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898336512:0@lo:400: 00000100:00100000:0.0:1789185582.011790:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.011806:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898336128:12345-0@lo:13: Request processed in 8295us (18322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.011819:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185582.011819:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898337024:0@lo:400: 00000100:00100000:3.0:1789185582.011859:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898336640 00000100:00100000:3.0:1789185582.011870:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898336640 00000100:00100000:3.0:1789185582.011930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898336384 00000100:00100000:3.0:1789185582.011935:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898336384 00000100:00100000:3.0:1789185582.011968:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185582.011978:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898336640:12345-0@lo:400: 00000100:00100000:0.0:1789185582.012380:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.012438:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898337024 00000100:00100000:0.0:1789185582.012443:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898337024 00000100:00100000:0.0:1789185582.012485:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185582.012504:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898336384:12345-0@lo:400: 00000100:00100000:2.0:1789185582.012639:0:6513:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789185582.012652:0:6513:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789185582.012803:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.012874:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898336640:12345-0@lo:400: Request processed in 896us (11195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.012882:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185582.012899:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898336896 00000100:00100000:3.0:1789185582.012902:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898336896 00000100:00100000:3.0:1789185582.012940:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185582.012946:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898337024:12345-0@lo:400: 00000100:00100000:3.0:1789185582.012981:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898337024:12345-0@lo:400: Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.012987:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185582.013016:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185582.013032:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898336896:12345-0@lo:400: 00000100:00100000:0.0:1789185582.013052:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898336384:12345-0@lo:400: Request processed in 547us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.013072:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789185582.013095:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185582.013099:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185582.013137:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898336256:0@lo:400: 00000100:00100000:0.0:1789185582.013156:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898336768:0@lo:400: 00010000:00080000:0.0:1789185582.013175:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2300380 x1876096898336128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185582.013210:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898336128:0@lo:13: 00010000:00080000:0.0:1789185582.013261:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b2d80 x1876096898337024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185582.013271:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898337024:0@lo:400: 00000100:00100000:0.0:1789185582.013314:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898336512 00000100:00100000:0.0:1789185582.013319:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898336512 00000100:00100000:0.0:1789185582.013350:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789185582.013357:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898336512:12345-0@lo:400: 00000100:00100000:0.0:1789185582.013401:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898336512:12345-0@lo:400: Request processed in 44us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.013408:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789185582.013433:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898336512:0@lo:400: 00010000:00080000:2.0:1789185582.014385:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b0380 x1876096898336640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185582.014403:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898336640:0@lo:400: 00010000:00080000:1.0:1789185582.020851:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b0700 x1876096898336384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185582.020878:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898336384:0@lo:400: 00000100:00100000:3.0:1789185582.029784:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898336896:12345-0@lo:400: Request processed in 16735us (16963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.029804:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789185582.030554:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b1f80 x1876096898336896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185582.030599:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898336896:0@lo:400: 00010000:00010000:0.0:1789185582.374340:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789185582.643643:0:9506:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789185582.643647:0:9506:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789185582.643654:0:9506:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789185582.643784:0:9506:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98f2ff976000 00000020:01000004:0.0:1789185582.643800:0:9506:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789185582.643813:0:9506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789185582.643825:0:9506:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98f2f27a0000) 00000020:00000080:0.0:1789185582.643842:0:9506:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789185582.680459:0:9506:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789185582.680512:0:9506:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1789185582.731266:0:9506:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789185582.731498:0:9506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789185582.731512:0:9506:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789185582.731523:0:9506:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xda5c730d5a72c19 00000020:01000004:1.0:1789185582.731530:0:9506:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789185582.731556:0:9506:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789185582.731560:0:9506:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789185582.731566:0:9506:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789185582.731604:0:9506:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789185582.731609:0:9506:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789185582.751172:0:9506:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789185582.751280:0:9506:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.148@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789185582.751284:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789185582.751286:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789185582.751288:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185582.751289:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185582.751290:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185582.751291:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185582.751292:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185582.751294:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185582.751295:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185582.751297:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185582.751298:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185582.751301:0:9506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789185582.751303:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185582.751305:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789185582.751307:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185582.751308:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185582.751309:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185582.751310:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185582.751311:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185582.751312:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185582.751313:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185582.751314:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185582.751314:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185582.751349:0:9506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789185582.751369:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898337152:0@lo:253: 00000100:00100000:2.0:1789185582.751448:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.751509:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f28c7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789185582.752299:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898337152 00000100:00100000:3.0:1789185582.752309:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898337152 00000100:00100000:3.0:1789185582.752374:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789185582.752385:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:9506:x1876096898337152:12345-0@lo:253: 20000000:01000000:3.0:1789185582.752418:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789185582.752423:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789185582.752428:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789185582.752432:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789185582.752705:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185582.752840:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1789185582.752857:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789185582.752874:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1789185582.752879:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789185582.752891:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1789185582.753185:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1789185582.753293:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1789185582.753309:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.148@tcp 20000000:01000000:3.0:1789185582.753310:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789185582.753322:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1789185582.753327:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789185582.753339:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1789185582.753344:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:3.0:1789185582.753355:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1789185582.753361:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789185582.753372:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1789185582.753388:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1789185582.753478:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1789185582.753488:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.148@tcp 20000000:01000000:3.0:1789185582.753490:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789185582.753501:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1789185582.753505:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789185582.753517:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1789185582.753521:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:3.0:1789185582.753532:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1789185582.753538:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789185582.753548:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1789185582.753560:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1789185582.753905:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789185582.756193:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.148@tcp 20000000:01000000:0.0:1789185582.756197:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.148@tcp (null) (null) (null) 00000040:00080000:0.0:1789185582.756240:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789185582.756249:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789185582.756265:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789185582.756270:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.148@tcp (null) (null) 00000040:00080000:0.0:1789185582.756284:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789185582.756290:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789185582.756300:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789185582.756317:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789185582.756347:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789185582.756349:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789185582.756353:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789185582.756399:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789185582.756402:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789185582.759037:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789185582.759333:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789185582.759363:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789185582.759380:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1789185582.759393:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789185582.759396:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789185582.766377:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789185582.766434:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789185582.766452:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1789185582.771329:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1789185582.771371:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1789185582.771387:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1789185582.771429:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789185582.771433:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789185582.772821:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1789185582.772865:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1789185582.772883:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1789185582.773213:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1789185582.773237:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1789185582.773266:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1789185582.773280:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789185582.773282:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789185582.773767:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789185582.773797:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789185582.773810:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789185582.774060:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789185582.774081:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789185582.774094:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789185582.774111:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789185582.774113:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789185582.774489:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789185582.774509:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789185582.774523:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1789185582.774659:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1789185582.774679:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1789185582.774693:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:2.0:1789185582.774709:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789185582.774730:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774749:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b0f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774757:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b39 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774763:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b78 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774769:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b94 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774777:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72bbe expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774790:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72bda expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774797:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c04 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774804:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774844:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72c04 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.774858:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72c04 expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.774872:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337280:0@lo:104: 00000100:00100000:2.0:1789185582.774974:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185582.775032:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72bda expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.775041:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72bda expref: 21 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.775050:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337408:0@lo:104: 00000100:00100000:2.0:1789185582.775072:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185582.775100:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72bbe expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.775108:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72bbe expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.775122:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337536:0@lo:104: 00000100:00100000:2.0:1789185582.775145:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185582.775161:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72b94 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.775169:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72b94 expref: 21 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.775177:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337664:0@lo:104: 00000100:00100000:2.0:1789185582.775195:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185582.775210:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72b78 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.775217:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72b78 expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.775223:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337792:0@lo:104: 00000100:00100000:2.0:1789185582.775240:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185582.775254:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72b39 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.775260:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72b39 expref: 21 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.775267:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337920:0@lo:104: 00000100:00100000:2.0:1789185582.775286:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185582.775301:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72b0f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.775319:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72b0f expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.775326:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898338048:0@lo:104: 00000100:00100000:2.0:1789185582.775345:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce257480 going to sleep for 11 seconds 00000100:00100000:1.0:1789185582.775533:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789185582.775550:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185582.775561:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898337280 00000100:00100000:1.0:1789185582.775568:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898337280 00000100:00100000:1.0:1789185582.775600:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898337408 00000100:00100000:1.0:1789185582.775604:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898337408 00000100:00100000:1.0:1789185582.775614:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898337536 00000100:00100000:1.0:1789185582.775617:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898337536 00000100:00100000:1.0:1789185582.775625:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898337664 00000100:00100000:1.0:1789185582.775627:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898337664 00000100:00100000:1.0:1789185582.775634:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898337792 00000100:00100000:1.0:1789185582.775636:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898337792 00000100:00100000:1.0:1789185582.775651:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898337920 00000100:00100000:1.0:1789185582.775653:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898337920 00000100:00100000:1.0:1789185582.775659:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898338048 00000100:00100000:1.0:1789185582.775661:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898338048 00000100:00100000:1.0:1789185582.775672:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185582.775680:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6506:x1876096898337280:12345-0@lo:104: 00010000:00010000:1.0:1789185582.775692:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.775751:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789185582.775757:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+9:6506:x1876096898337280:12345-0@lo:104: Request processed in 78us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.775764:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185582.775781:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185582.775788:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+8:6506:x1876096898337408:12345-0@lo:104: 00010000:00010000:1.0:1789185582.775795:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.775826:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789185582.775831:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+8:6506:x1876096898337408:12345-0@lo:104: Request processed in 44us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.775836:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185582.775849:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185582.775854:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+7:6506:x1876096898337536:12345-0@lo:104: 00010000:00010000:1.0:1789185582.775861:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.775885:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789185582.775896:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+7:6506:x1876096898337536:12345-0@lo:104: Request processed in 42us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.775901:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185582.775953:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185582.775959:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+6:6506:x1876096898337664:12345-0@lo:104: 00010000:00010000:1.0:1789185582.775967:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.776004:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789185582.776008:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+6:6506:x1876096898337664:12345-0@lo:104: Request processed in 50us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.776014:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789185582.776026:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789185582.776031:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+5:6506:x1876096898337792:12345-0@lo:104: 00010000:00010000:1.0:1789185582.776038:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.776062:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789185582.776066:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+5:6506:x1876096898337792:12345-0@lo:104: Request processed in 36us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.776072:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789185582.776083:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789185582.776088:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6506:x1876096898337920:12345-0@lo:104: 00010000:00010000:1.0:1789185582.776094:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.776119:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789185582.776129:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6506:x1876096898337920:12345-0@lo:104: Request processed in 41us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.776135:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789185582.776163:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789185582.776169:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6506:x1876096898338048:12345-0@lo:104: 00010000:00010000:1.0:1789185582.776177:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.776202:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789185582.776207:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6506:x1876096898338048:12345-0@lo:104: Request processed in 39us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.776212:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185582.776351:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337280:0@lo:104: 00000100:00100000:2.0:1789185582.776360:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337408:0@lo:104: 00000100:00100000:2.0:1789185582.776366:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337536:0@lo:104: 00000100:00100000:2.0:1789185582.776373:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337664:0@lo:104: 00000100:00100000:2.0:1789185582.776378:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337792:0@lo:104: 00000100:00100000:2.0:1789185582.776384:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898337920:0@lo:104: 00000100:00100000:2.0:1789185582.776390:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876096898338048:0@lo:104: 00010000:00010000:2.0:1789185582.776413:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776490:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789185582.776497:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776503:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185582.776507:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776515:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185582.776521:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185582.776528:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185582.776564:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776582:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185582.776604:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776612:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72c04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776626:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789185582.776629:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776634:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185582.776637:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776644:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185582.776651:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185582.776656:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185582.776669:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776675:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185582.776680:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776687:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72be1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776701:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789185582.776705:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776710:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185582.776713:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776719:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185582.776726:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185582.776731:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185582.776744:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776751:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185582.776765:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776771:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72bc5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776780:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789185582.776782:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776799:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185582.776802:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776809:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185582.776816:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185582.776821:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185582.776834:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776839:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185582.776845:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776851:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72b94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776860:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789185582.776863:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776867:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddea00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185582.776870:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.776886:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185582.776892:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185582.776898:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185582.777024:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789185582.777049:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898338560:0@lo:103: 00000100:00100000:0.0:1789185582.777095:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.777132:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185582.777137:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898338432:0@lo:103: 00000100:00100000:0.0:1789185582.777157:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.777186:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898338560 00000100:00100000:0.0:1789185582.777191:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898338560 00010000:00010000:0.0:1789185582.777216:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b94 expref: 22 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.777237:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898338432 00000100:00100000:0.0:1789185582.777240:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898338432 00010000:00010000:0.0:1789185582.777251:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72bbe expref: 23 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.777263:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789185582.777270:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3636:x1876096898338560:12345-0@lo:103: 00010000:00010000:0.0:1789185582.777281:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185582.777285:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b94 expref: 23 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.777294:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72b94 expref: 23 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.777320:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72b9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72b94 expref: 23 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.777333:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185582.777365:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3636:x1876096898338560:12345-0@lo:103: Request processed in 95us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.777371:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789185582.777386:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789185582.777392:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3636:x1876096898338432:12345-0@lo:103: 00010000:00010000:0.0:1789185582.777399:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185582.777403:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72bbe expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.777411:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72bbe expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.777422:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72bbe expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.777430:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185582.777451:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:3636:x1876096898338432:12345-0@lo:103: Request processed in 59us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.777456:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789185582.777492:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898338432:0@lo:103: 00000100:00100000:0.0:1789185582.777499:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898338560:0@lo:103: 00010000:00010000:0.0:1789185582.777637:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185582.777644:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.777657:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde600 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185582.777661:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.777668:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185582.777675:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.777886:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.777893:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185582.777900:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.777928:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300ddea00/0xda5c730d5a72b78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.777938:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185582.777940:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185582.777942:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185582.777953:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898338176:0@lo:103: 00000100:00100000:3.0:1789185582.777994:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.778017:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898338688:0@lo:103: 00000100:00100000:3.0:1789185582.778038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.778056:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185582.778061:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898338304:0@lo:103: 00000100:00100000:3.0:1789185582.778081:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.778114:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898338176 00000100:00100000:3.0:1789185582.778124:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898338176 00010000:00010000:3.0:1789185582.778140:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c04 expref: 20 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185582.778155:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898338688 00000100:00100000:3.0:1789185582.778157:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898338688 00010000:00010000:3.0:1789185582.778167:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b78 expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185582.778175:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898338304 00000100:00100000:3.0:1789185582.778178:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898338304 00010000:00010000:3.0:1789185582.778186:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72bda expref: 22 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185582.778197:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185582.778202:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3637:x1876096898338176:12345-0@lo:103: 00010000:00010000:3.0:1789185582.778209:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185582.778213:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c04 expref: 22 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.778222:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72c04 expref: 22 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.778232:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72c0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72c04 expref: 22 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.778242:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185582.778268:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3637:x1876096898338176:12345-0@lo:103: Request processed in 66us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.778274:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185582.778286:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185582.778298:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:3637:x1876096898338688:12345-0@lo:103: 00010000:00010000:3.0:1789185582.778304:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185582.778308:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b78 expref: 20 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.778317:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72b78 expref: 20 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.778326:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72b78 expref: 20 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.778335:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185582.778353:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3637:x1876096898338688:12345-0@lo:103: Request processed in 56us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.778358:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185582.778399:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185582.778405:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3637:x1876096898338304:12345-0@lo:103: 00010000:00010000:3.0:1789185582.778412:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185582.778416:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72bda expref: 18 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.778424:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72bda expref: 18 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.778434:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72bda expref: 18 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.778443:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185582.778463:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:3637:x1876096898338304:12345-0@lo:103: Request processed in 58us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.778478:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185582.778507:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898338304:0@lo:103: 00000100:00100000:3.0:1789185582.778514:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898338176:0@lo:103: 00000100:00100000:3.0:1789185582.778520:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898338688:0@lo:103: 10000000:01000000:0.0:1789185582.778658:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185582.778681:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.778687:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185582.778705:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.778712:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72b39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b40 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.778722:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185582.778724:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185582.778725:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185582.778940:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898338816:0@lo:103: 00000100:00100000:3.0:1789185582.778965:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.779105:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898338816 00000100:00100000:2.0:1789185582.779111:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898338816 00010000:00010000:2.0:1789185582.779132:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b39 expref: 17 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.779151:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185582.779157:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:3638:x1876096898338816:12345-0@lo:103: 00010000:00010000:2.0:1789185582.779164:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185582.779168:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b39 expref: 17 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.779189:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72b39 expref: 17 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.779199:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a72b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72b39 expref: 17 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.779209:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185582.779241:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3638:x1876096898338816:12345-0@lo:103: Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185582.779247:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185582.779293:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898338816:0@lo:103: 00010000:00010000:3.0:1789185582.779651:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185582.779654:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185582.779656:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185582.779678:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.779686:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:1.0:1789185582.779690:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.779698:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185582.779705:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185582.779710:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789185582.779773:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.779780:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789185582.779826:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789185582.779845:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.779853:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a72b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b16 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.779867:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185582.779869:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185582.779871:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185582.780146:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898338944:0@lo:103: 00000100:00100000:0.0:1789185582.780182:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.780262:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898338944 00000100:00100000:2.0:1789185582.780267:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898338944 00010000:00010000:2.0:1789185582.780286:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b0f expref: 16 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.780343:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185582.780352:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3636:x1876096898338944:12345-0@lo:103: 00010000:00010000:2.0:1789185582.780361:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185582.780364:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b0f expref: 16 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780373:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72b0f expref: 16 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780383:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72b0f expref: 16 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780394:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780407:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780420:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780426:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780432:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780437:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780442:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfa00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185582.780446:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.780453:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.780565:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.780584:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789185582.780593:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1789185582.782663:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.782684:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c20 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.782703:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185582.782825:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:3636:x1876096898338944:12345-0@lo:103: Request processed in 2471us (2637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185582.782847:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789185582.783141:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898338944:0@lo:103: 00000100:00100000:0.0:1789185582.786070:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+14:9506:x1876096898337152:12345-0@lo:253: Request processed in 33679us (34613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.786086:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789185582.786088:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898337152:0@lo:253: 10000000:01000000:2.0:1789185582.786102:0:9506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789185582.786105:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185582.786106:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789185582.786108:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185582.786109:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789185582.786110:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185582.786111:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185582.786112:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185582.786114:0:9506:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789185582.786115:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185582.786117:0:9506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789185582.786136:0:9506:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f2ff976000 from lustre-OST0001 10000000:01000000:2.0:1789185582.786164:0:9506:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789185582.786167:0:9506:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789185582.786177:0:9506:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f2c6fd4d40 local copy 10000000:01000000:2.0:1789185582.786181:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789185582.786215:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.786227:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.786236:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.786253:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339072:0@lo:101: 00000100:00100000:2.0:1789185582.786285:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.786325:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce257cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185582.786337:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898339072 00000100:00100000:1.0:1789185582.786345:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898339072 00000100:00100000:1.0:1789185582.786394:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789185582.786403:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+14:9506:x1876096898339072:12345-0@lo:101: 00010000:00010000:1.0:1789185582.786416:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185582.786430:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166d200/0xda5c730d5a72c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72c27 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.786453:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166d200/0xda5c730d5a72c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72c27 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.786465:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166d200/0xda5c730d5a72c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c27 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.786474:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166d200, rc 0) 00000100:00100000:1.0:1789185582.786515:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339072:12345-0@lo:101: Request processed in 113us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.786521:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789185582.787054:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339072:0@lo:101: 00010000:00010000:3.0:1789185582.787069:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.787080:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185582.787176:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339200:0@lo:501: 00000100:00100000:3.0:1789185582.787203:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.787229:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7544b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185582.787633:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898339200 00000100:00100000:2.0:1789185582.787655:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898339200 00000100:00100000:2.0:1789185582.787696:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789185582.787704:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339200:12345-0@lo:501: 00000100:00100000:2.0:1789185582.787798:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339200:12345-0@lo:501: Request processed in 96us (594us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185582.787806:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789185582.788031:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339200:0@lo:501: 10000000:01000000:3.0:1789185582.788046:0:9506:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789185582.788064:0:9506:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789185582.788070:0:9506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.788090:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.788097:0:9506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.788121:0:9506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789185582.788146:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f2ff976000 10000000:01000000:3.0:1789185582.788150:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789185582.788155:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789185582.788157:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185582.788161:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789185582.788164:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789185582.788184:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.788191:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.788200:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185582.788214:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339328:0@lo:101: 00000100:00100000:3.0:1789185582.788241:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.788266:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e02f4f00 going to sleep for 11 seconds 00010000:00010000:0.0:1789185582.788310:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185582.788316:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.788324:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfe00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185582.788328:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.788337:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185582.788345:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185582.788350:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185582.788368:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.788374:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185582.788400:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.788418:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300ddfe00/0xda5c730d5a72c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xda5c730d5a72c2e expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.788429:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185582.788431:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185582.788433:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185582.788471:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185582.788482:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898339456:0@lo:103: 00000100:00100000:3.0:1789185582.788508:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.788576:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898339456 00000100:00100000:0.0:1789185582.788581:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898339456 00000100:00100000:0.0:1789185582.788622:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185582.788628:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898339328 00000100:00100000:0.0:1789185582.788630:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:3635:x1876096898339456:12345-0@lo:103: 00000100:00100000:2.0:1789185582.788632:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898339328 00010000:00010000:0.0:1789185582.788641:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185582.788652:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166d200/0xda5c730d5a72c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72c27 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.788655:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789185582.788661:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898339328:12345-0@lo:101: 00010000:00010000:0.0:1789185582.788667:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185582.788669:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185582.788678:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72c35 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.788694:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72c35 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.788697:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3635:x1876096898339456:12345-0@lo:103: Request processed in 69us (189us total) trans 0 rc 0/0 00010000:00010000:2.0:1789185582.788704:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c35 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.788704:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789185582.788710:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddfa00, rc 0) 00000100:00100000:0.0:1789185582.788744:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898339456:0@lo:103: 00000100:00100000:2.0:1789185582.788749:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339328:12345-0@lo:101: Request processed in 89us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185582.788754:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789185582.789007:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339328:0@lo:101: 00010000:00010000:2.0:1789185582.789021:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.789186:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185582.789268:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339584:0@lo:501: 00000100:00100000:2.0:1789185582.789297:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.789328:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce257540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185582.789343:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898339584 00000100:00100000:2.0:1789185582.789347:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898339584 00000100:00100000:2.0:1789185582.789378:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789185582.789385:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339584:12345-0@lo:501: 00000100:00100000:2.0:1789185582.789486:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339584:12345-0@lo:501: Request processed in 101us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185582.789493:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789185582.790004:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339584:0@lo:501: 00000100:00100000:3.0:1789185582.790039:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339712:0@lo:503: 00000100:00100000:3.0:1789185582.790080:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.790111:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e02f40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185582.790167:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898339712 00000100:00100000:1.0:1789185582.790172:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898339712 00000100:00100000:1.0:1789185582.790233:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789185582.790242:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339712:12345-0@lo:503: 00000100:00100000:1.0:1789185582.790337:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339712:12345-0@lo:503: Request processed in 96us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.790343:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789185582.790412:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339712:0@lo:503: 00000040:00080000:3.0:1789185582.790679:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789185582.790741:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339840:0@lo:502: 00000100:00100000:3.0:1789185582.790774:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.796748:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898339840 00000100:00100000:0.0:1789185582.796763:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898339840 00000100:00100000:2.0:1789185582.797122:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789185582.797153:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e02f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185582.797170:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339840:12345-0@lo:502: 00000100:00100000:2.0:1789185582.797335:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339840:12345-0@lo:502: Request processed in 203us (6560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185582.797343:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789185582.797469:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339840:0@lo:502: 00000040:00080000:3.0:1789185582.797857:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789185582.797890:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789185582.797905:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789185582.797952:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789185582.797967:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789185582.797980:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789185582.798024:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339968:0@lo:502: 00000100:00100000:3.0:1789185582.798070:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.798089:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e02f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185582.798279:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898339968 00000100:00100000:2.0:1789185582.798286:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898339968 00000100:00100000:2.0:1789185582.798329:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789185582.798338:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339968:12345-0@lo:502: 00000100:00100000:2.0:1789185582.798425:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898339968:12345-0@lo:502: Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185582.798432:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789185582.798477:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898339968:0@lo:502: 00000040:00080000:2.0:1789185582.798520:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789185582.798533:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789185582.799059:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789185582.799066:0:9519:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789185582.799073:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185582.799075:0:9519:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789185582.799080:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185582.799095:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98f2f75e19c0) 00000020:00000080:1.0:1789185582.799118:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789185582.799123:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789185582.799184:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f2ff976000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789185582.799192:0:9519:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789185582.799197:0:9519:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xda5c730d5a72c4a 00010000:00010000:2.0:1789185582.810353:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1789185582.813080:0:9519:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789185582.820167:0:9519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789185582.821699:0:9519:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789185582.827643:0:9519:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789185582.828375:0:9519:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789185582.840755:0:9519:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789185582.854399:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789185582.854414:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185582.854421:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185582.854423:0:9519:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789185582.854427:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185582.854432:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185582.854433:0:9519:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789185582.854437:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789185582.854439:0:9519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789185582.854465:0:9519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185582.854468:0:9519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185582.854469:0:9519:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789185582.854472:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789185582.855673:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789185582.855722:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789185582.855742:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.855755:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185582.855763:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2ff976000 from 1 10000000:01000000:3.0:1789185582.855780:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185582.855821:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.855829:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185582.855839:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185582.855864:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340096:0@lo:101: 00000100:00100000:3.0:1789185582.855968:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.856026:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e02f4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185582.856112:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898340096 00000100:00100000:0.0:1789185582.856120:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898340096 00000100:00100000:0.0:1789185582.856171:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789185582.856181:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898340096:12345-0@lo:101: 00010000:00010000:0.0:1789185582.856193:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185582.856207:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72c51 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.856239:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72c51 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.856248:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c51 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.856256:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031e00, rc 0) 00000100:00100000:0.0:1789185582.856298:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340096:12345-0@lo:101: Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.856304:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789185582.856366:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340096:0@lo:101: 00010000:00010000:0.0:1789185582.856379:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.856387:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.856484:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340224:0@lo:501: 00000100:00100000:0.0:1789185582.856507:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.856526:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b4540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185582.856539:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898340224 00000100:00100000:0.0:1789185582.856543:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898340224 00000100:00100000:0.0:1789185582.856581:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789185582.856588:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340224:12345-0@lo:501: 00000100:00100000:0.0:1789185582.856688:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340224:12345-0@lo:501: Request processed in 99us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.856695:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789185582.856734:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340224:0@lo:501: 00000100:00100000:0.0:1789185582.856766:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340352:0@lo:503: 00000100:00100000:0.0:1789185582.856803:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.856815:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b4540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185582.856827:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898340352 00000100:00100000:0.0:1789185582.856830:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898340352 00000100:00100000:0.0:1789185582.856849:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789185582.856855:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340352:12345-0@lo:503: 00000100:00100000:0.0:1789185582.856958:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340352:12345-0@lo:503: Request processed in 103us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.856965:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789185582.857018:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340352:0@lo:503: 00000040:00080000:0.0:1789185582.857268:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789185582.857354:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340480:0@lo:502: 00000100:00100000:0.0:1789185582.857383:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.857397:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b4540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185582.857410:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898340480 00000100:00100000:0.0:1789185582.857413:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898340480 00000100:00100000:0.0:1789185582.857430:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789185582.857436:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340480:12345-0@lo:502: 00000100:00100000:0.0:1789185582.857497:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340480:12345-0@lo:502: Request processed in 61us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.857503:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789185582.857535:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340480:0@lo:502: 00000040:00080000:0.0:1789185582.857729:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789185582.857753:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789185582.857775:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340608:0@lo:502: 00000100:00100000:0.0:1789185582.857803:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.857817:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b4540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185582.857829:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898340608 00000100:00100000:0.0:1789185582.857832:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898340608 00000100:00100000:0.0:1789185582.857855:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789185582.857860:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340608:12345-0@lo:502: 00000100:00100000:0.0:1789185582.857943:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340608:12345-0@lo:502: Request processed in 82us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.857949:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789185582.857995:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340608:0@lo:502: 00000040:00080000:0.0:1789185582.858029:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789185582.858037:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789185582.858274:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185582.858282:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185582.858284:0:9522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789185582.858289:0:9522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f2ff976000 00000020:00000080:0.0:1789185582.858292:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185582.858302:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185582.858304:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185582.858305:0:9522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789185582.858307:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789185582.858335:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789185582.858392:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789185582.858400:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.858409:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185582.858480:0:9506:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789185582.858483:0:9506:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f2ff976000 10000000:01000000:0.0:1789185582.858485:0:9506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f2ff976000 10000000:01000000:0.0:1789185582.858489:0:9506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789185582.858493:0:9506:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2ff976000 from 1 10000000:01000000:0.0:1789185582.858496:0:9506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789185582.858516:0:9506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.858523:0:9506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.858532:0:9506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.858543:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340736:0@lo:101: 00000100:00100000:0.0:1789185582.858570:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.858584:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185582.858597:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898340736 00000100:00100000:0.0:1789185582.858600:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898340736 00000100:00100000:0.0:1789185582.858620:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789185582.858626:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9506:x1876096898340736:12345-0@lo:101: 00010000:00010000:0.0:1789185582.858636:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185582.858649:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72c5f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.858669:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72c5f expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.858689:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c5f expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.858698:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0030000, rc 0) 00000100:00100000:0.0:1789185582.858730:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898340736:12345-0@lo:101: Request processed in 104us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.858736:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789185582.858773:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340736:0@lo:101: 00010000:00010000:0.0:1789185582.858784:0:9506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.858794:0:9506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.858846:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340864:0@lo:501: 00000100:00100000:0.0:1789185582.858870:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.858882:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185582.858893:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898340864 00000100:00100000:0.0:1789185582.858897:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898340864 00000100:00100000:0.0:1789185582.866976:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789185582.867007:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898340864:12345-0@lo:501: 00000100:00100000:0.0:1789185582.867190:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898340864:12345-0@lo:501: Request processed in 194us (8318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.867199:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789185582.867405:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340864:0@lo:501: 00000100:00100000:2.0:1789185582.867453:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340992:0@lo:503: 00000100:00100000:2.0:1789185582.867500:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.867531:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185582.867646:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898340992 00000100:00100000:0.0:1789185582.867653:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898340992 00000100:00100000:0.0:1789185582.867703:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789185582.867710:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898340992:12345-0@lo:503: 00000100:00100000:0.0:1789185582.867821:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898340992:12345-0@lo:503: Request processed in 111us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.867827:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789185582.867949:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898340992:0@lo:503: 00000040:00080000:2.0:1789185582.868216:0:9506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789185582.868299:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898341120:0@lo:502: 00000100:00100000:2.0:1789185582.868339:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.868356:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185582.868414:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898341120 00000100:00100000:1.0:1789185582.868420:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898341120 00000100:00100000:1.0:1789185582.868455:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789185582.868462:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898341120:12345-0@lo:502: 00000100:00100000:1.0:1789185582.868569:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898341120:12345-0@lo:502: Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.868576:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789185582.869689:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898341120:0@lo:502: 00000040:00080000:2.0:1789185582.869896:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789185582.869956:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789185582.869971:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789185582.869994:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789185582.870008:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789185582.870021:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789185582.870034:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789185582.870047:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789185582.870059:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789185582.870071:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789185582.870093:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789185582.870105:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789185582.870118:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789185582.870129:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789185582.870139:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789185582.870166:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789185582.870183:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789185582.870196:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789185582.870209:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789185582.870221:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789185582.870232:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789185582.870245:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789185582.870258:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789185582.870270:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789185582.870282:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789185582.870300:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789185582.870311:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789185582.870322:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789185582.870333:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789185582.870343:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789185582.870353:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789185582.870376:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789185582.870389:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789185582.870402:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789185582.870415:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789185582.870426:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789185582.870437:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1789185582.870449:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789185582.870461:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1789185582.870472:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1789185582.870484:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1789185582.870495:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1789185582.870507:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1789185582.870530:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1789185582.870544:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1789185582.871055:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1789185582.871094:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898341248:0@lo:502: 00000100:00100000:2.0:1789185582.871161:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.871199:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185582.871245:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898341248 00000100:00100000:1.0:1789185582.871252:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898341248 00000100:00100000:1.0:1789185582.871301:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789185582.871311:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898341248:12345-0@lo:502: 00000100:00100000:1.0:1789185582.871422:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898341248:12345-0@lo:502: Request processed in 113us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.871429:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789185582.871561:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898341248:0@lo:502: 00000040:00080000:3.0:1789185582.871607:0:9506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1789185582.871615:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1789185582.872234:0:9524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789185582.872252:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98f1c2073380) 00000020:00000080:3.0:1789185582.872277:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1789185582.872369:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f2ff976000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789185582.872373:0:9524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2ff976000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789185582.872375:0:9524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2ff976000 3 00010000:00080000:3.0:1789185582.872402:0:9524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c316b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.148@tcp at head 00010000:00010000:3.0:1789185582.876466:0:9524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1789185582.879190:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789185582.879637:0:9524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789185582.879653:0:9524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xda5c730d5a72c74 00000100:00080000:3.0:1789185582.879666:0:9524:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185582.879679:0:9524:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f1c316b800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185582.879721:0:9524:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b5c00 x1876096898341376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185582.879768:0:9524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789185582.879870:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898341376:0@lo:38: 00000100:00100000:1.0:1789185582.879957:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789185582.884077:0:9524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789185582.884105:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98f2f75e0000) 00000020:00000080:1.0:1789185582.884134:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1789185582.884264:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f2ff976000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789185582.884271:0:9524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2ff976000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789185582.884274:0:9524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2ff976000 3 00010000:00080000:1.0:1789185582.884303:0:9524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c30fc000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.148@tcp at head 00010000:00010000:1.0:1789185582.885867:0:9524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:0.0:1789185582.886846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898341376 00000100:00100000:0.0:1789185582.886860:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898341376 00000020:00000080:1.0:1789185582.887133:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789185582.887178:0:9524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789185582.887191:0:9524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xda5c730d5a72c82 00000100:00080000:1.0:1789185582.887200:0:9524:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185582.887225:0:9524:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98f1c30fc000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185582.887272:0:9524:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c2c04a80 x1876096898341504/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185582.887324:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876096898341504:0@lo:38: 00000100:00100000:1.0:1789185582.887394:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789185582.887448:0:9524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789185582.888118:0:9525:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff98f1c19b4000 x1876096898341632/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185582.888130:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 0 seconds 00000100:00100000:1.0:1789185582.892018:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898341504 00000100:00100000:1.0:1789185582.892035:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898341504 00000100:00100000:1.0:1789185582.892088:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185582.892097:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876096898341376:12345-0@lo:38: 00010000:00080000:1.0:1789185582.892130:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1789185582.892170:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xda5c730d5a72c89 00000004:00100000:1.0:1789185582.892187:0:6513:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789185582.892234:0:6513:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185582.893577:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1876096898341376:12345-0@lo:38: Request processed in 1474us (13612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.893588:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185582.893620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185582.893626:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876096898341504:12345-0@lo:38: 00010000:00080000:1.0:1789185582.893651:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1789185582.893700:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xda5c730d5a72c90 00000004:00100000:1.0:1789185582.893710:0:6513:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789185582.893737:0:6513:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185582.893769:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876096898341504:12345-0@lo:38: Request processed in 142us (6375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.893775:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789185582.893825:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c2c04a80 x1876096898341504/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185582.893849:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185582.893857:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789185582.893865:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789185582.893870:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789185582.893872:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789185582.893878:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876096898341504:0@lo:38: 00010000:00080000:1.0:1789185582.893893:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b5c00 x1876096898341376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185582.893900:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789185582.893903:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789185582.893925:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789185582.893928:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789185582.893930:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789185582.893935:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003201b21b): req@ffff98f1c19b4000 x1876096898341632/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185582.893949:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898341376:0@lo:38: 00000100:00100000:3.0:1789185582.894441:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.894471:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 11 seconds 00000040:00080000:3.0:1789185582.895083:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:0.0:1789185582.895524:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898341632 00000100:00100000:0.0:1789185582.895533:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898341632 00000100:00100000:0.0:1789185582.895593:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185582.895602:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9525:x1876096898341632:12345-0@lo:901: 00000100:00100000:0.0:1789185582.895724:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9525:x1876096898341632:12345-0@lo:901: Request processed in 123us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.895732:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789185582.895774:0:9525:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c19b4000 x1876096898341632/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789185598 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185582.895787:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9525:1876096898341632:0@lo:901: 00000100:00080000:3.0:1789185582.895991:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1789185582.896063:0:9506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789185582.896123:0:9506:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789185582.896144:0:9506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185582.896156:0:9506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789185582.898483:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789185582.898491:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789185582.898493:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185582.898494:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185582.898495:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185582.898497:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185582.898499:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185582.898500:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185582.898502:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185582.898503:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185582.898505:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185582.898510:0:9506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789185582.898513:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185582.898515:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789185582.898515:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185582.898517:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185582.898518:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185582.898519:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185582.898520:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185582.898521:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789185582.898522:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789185582.898523:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185582.898531:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185582.898565:0:9506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789185582.898586:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898341760:0@lo:253: 00000100:00100000:2.0:1789185582.898659:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.898706:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185582.898763:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185582.898775:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898341888:0@lo:400: 00000100:00100000:2.0:1789185582.898804:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.898843:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898342016:0@lo:400: 00000100:00100000:2.0:1789185582.898883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185582.901044:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898341888 00000100:00100000:3.0:1789185582.901059:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898341888 00000100:00100000:3.0:1789185582.901134:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789185582.901144:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898341888:12345-0@lo:400: 00000100:00100000:3.0:1789185582.901316:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898341888:12345-0@lo:400: Request processed in 173us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.901324:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789185582.901457:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f2f2708700 x1876096898341888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185582.901475:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898341888:0@lo:400: 00000100:00100000:2.0:1789185582.901508:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898342016 00000100:00100000:2.0:1789185582.901513:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898342016 00000100:00100000:2.0:1789185582.901556:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185582.901563:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898342016:12345-0@lo:400: 00000100:00100000:2.0:1789185582.901608:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898342016:12345-0@lo:400: Request processed in 46us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185582.901613:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185582.901654:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898342016:0@lo:400: 00000100:00100000:2.0:1789185582.901700:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185582.901710:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898342144:0@lo:400: 00000100:00100000:2.0:1789185582.901742:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.901783:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898342272:0@lo:400: 00000100:00100000:2.0:1789185582.901804:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.901857:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185582.901863:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898342400:0@lo:400: 00000100:00100000:2.0:1789185582.901886:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.901946:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898342528:0@lo:400: 00000100:00100000:2.0:1789185582.901966:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.902014:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185582.902019:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898342656:0@lo:400: 00000100:00100000:2.0:1789185582.902043:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.902069:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898342656 00000100:00100000:2.0:1789185582.902073:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898342656 00000100:00100000:2.0:1789185582.902102:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789185582.902114:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898342656:12345-0@lo:400: 00000100:00100000:2.0:1789185582.902148:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898342656:12345-0@lo:400: Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185582.902154:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789185582.902181:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c33ec700 x1876096898342656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185582.902191:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898342656:0@lo:400: 00000100:00100000:2.0:1789185582.902230:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898342784:0@lo:400: 00000100:00100000:0.0:1789185582.902427:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898342272 00000100:00100000:0.0:1789185582.902431:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898342272 00000100:00100000:0.0:1789185582.902458:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789185582.902464:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898342272:12345-0@lo:400: 00000100:00100000:0.0:1789185582.902502:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898342272:12345-0@lo:400: Request processed in 38us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.902508:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789185582.902525:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898342144 00000100:00100000:0.0:1789185582.902529:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898342144 00000100:00100000:0.0:1789185582.902550:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898342400 00000100:00100000:0.0:1789185582.902562:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898342400 00000100:00100000:0.0:1789185582.902583:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898342528 00000100:00100000:0.0:1789185582.902586:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898342528 00000100:00100000:0.0:1789185582.902599:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789185582.902605:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898342144:12345-0@lo:400: 00000100:00100000:0.0:1789185582.902637:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898342144:12345-0@lo:400: Request processed in 31us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.902642:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789185582.902654:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789185582.902661:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898342400:12345-0@lo:400: 00000100:00100000:0.0:1789185582.902691:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898342400:12345-0@lo:400: Request processed in 31us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.902697:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789185582.902708:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789185582.902713:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898342528:12345-0@lo:400: 00000100:00100000:0.0:1789185582.902738:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898342528:12345-0@lo:400: Request processed in 25us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.902744:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789185582.902771:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c33eca80 x1876096898342528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185582.902782:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898342528:0@lo:400: 00010000:00080000:0.0:1789185582.902791:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c33ef800 x1876096898342400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185582.902799:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898342400:0@lo:400: 00000100:00100000:0.0:1789185582.902828:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898341760 00000100:00100000:0.0:1789185582.902833:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898341760 00000100:00100000:0.0:1789185582.902866:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789185582.902872:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9506:x1876096898341760:12345-0@lo:253: 20000000:01000000:0.0:1789185582.902897:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789185582.902933:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789185582.904638:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185582.907684:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898342272:0@lo:400: 00010000:00080000:2.0:1789185582.907708:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c33eea00 x1876096898342144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185582.907718:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898342144:0@lo:400: 00000100:00100000:3.0:1789185582.913103:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898342784 00000100:00100000:3.0:1789185582.913118:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898342784 00000100:00100000:3.0:1789185582.913169:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185582.913179:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898342784:12345-0@lo:400: 00000100:00100000:3.0:1789185582.913276:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898342784:12345-0@lo:400: Request processed in 99us (8645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185582.913284:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789185582.914925:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c33ec700 x1876096898342784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185582.914944:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898342784:0@lo:400: 20000000:01000000:0.0:1789185582.920168:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789185582.920189:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789185582.920413:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789185582.920418:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789185582.920441:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.920460:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b86 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.920466:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72bcc expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.920489:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.920526:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72bcc expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.920539:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72bcc expref: 17 pid: 6507 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185582.920553:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898342912:0@lo:104: 00000100:00100000:1.0:1789185582.920614:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185582.920661:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72b86 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185582.920669:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72b86 expref: 17 pid: 6506 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185582.920677:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c05c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898343040:0@lo:104: 00000100:00100000:1.0:1789185582.920698:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185582.920715:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ab6180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185582.921208:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898342912 00000100:00100000:0.0:1789185582.921217:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898342912 00000100:00100000:0.0:1789185582.921265:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898343040 00000100:00100000:0.0:1789185582.921269:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898343040 00000100:00100000:0.0:1789185582.921282:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789185582.921291:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6528:x1876096898342912:12345-0@lo:104: 00010000:00010000:0.0:1789185582.921303:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921361:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185582.921367:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:6528:x1876096898342912:12345-0@lo:104: Request processed in 77us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.921373:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789185582.921390:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789185582.921395:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6528:x1876096898343040:12345-0@lo:104: 00010000:00010000:0.0:1789185582.921404:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921434:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789185582.921447:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:6528:x1876096898343040:12345-0@lo:104: Request processed in 52us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.921453:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789185582.921469:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185582.921475:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921482:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185582.921485:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921493:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185582.921499:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185582.921507:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185582.921532:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921539:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185582.921556:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921562:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30da400/0xda5c730d5a72bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72bd3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921575:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185582.921578:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921594:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185582.921597:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921603:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185582.921609:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185582.921614:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185582.921627:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921633:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185582.921639:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921645:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72b86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921656:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185582.921658:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185582.921660:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185582.921677:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898343296:0@lo:103: 00000100:00100000:0.0:1789185582.921705:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.921726:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185582.921731:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898343168:0@lo:103: 00000100:00100000:0.0:1789185582.921760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185582.921783:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898343296 00000100:00100000:0.0:1789185582.921787:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898343296 00010000:00010000:0.0:1789185582.921818:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b86 expref: 18 pid: 6506 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.921837:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898343168 00000100:00100000:0.0:1789185582.921841:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898343168 00010000:00010000:0.0:1789185582.921851:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72bcc expref: 19 pid: 6507 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.921862:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789185582.921868:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3638:x1876096898343296:12345-0@lo:103: 00010000:00010000:0.0:1789185582.921878:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185582.921883:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b86 expref: 19 pid: 6506 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921892:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72b86 expref: 19 pid: 6506 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.921927:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185582.921953:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3638:x1876096898343296:12345-0@lo:103: Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.921959:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789185582.921972:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789185582.921978:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3638:x1876096898343168:12345-0@lo:103: 00010000:00010000:0.0:1789185582.922206:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185582.922212:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72bcc expref: 18 pid: 6507 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922231:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72bcc expref: 18 pid: 6507 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922300:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922309:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789185582.922322:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010452144s 00010000:00010000:0.0:1789185582.922327:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922334:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922341:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922347:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922352:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166da00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185582.922356:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922363:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922371:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922390:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185582.922415:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3638:x1876096898343168:12345-0@lo:103: Request processed in 438us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185582.922421:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789185582.922462:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898343168:0@lo:103: 00000100:00100000:0.0:1789185582.922471:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898343296:0@lo:103: 00010000:00010000:0.0:1789185582.922500:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300dde800/0xda5c730d5a72bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72bcc expref: 17 pid: 6507 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.922510:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898342912:0@lo:104: 00010000:00010000:0.0:1789185582.922518:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72b8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72b86 expref: 16 pid: 6506 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185582.922525:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c05c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876096898343040:0@lo:104: 00010000:00010000:0.0:1789185582.922537:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922545:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922551:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185582.922558:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72c97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185582.922697:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:9506:x1876096898341760:12345-0@lo:253: Request processed in 19824us (24037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185582.922705:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789185582.922892:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9010c27d-11d2-44c0-a2e4-e8975764c875:9506:1876096898341760:0@lo:253: 10000000:01000000:0.0:1789185582.922932:0:9506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789185582.922935:0:9506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789185582.922937:0:9506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789185582.922939:0:9506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185582.922940:0:9506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185582.922941:0:9506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185582.922943:0:9506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185582.922944:0:9506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789185582.922946:0:9506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789185582.922947:0:9506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789185582.922949:0:9506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185582.922950:0:9506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789185582.922961:0:9506:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789185582.923097:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789185582.933140:0:9506:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789185582.933433:0:9506:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789185582.933616:0:9506:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789185582.934417:0:9506:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789185582.934665:0:9506:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789185582.934853:0:9506:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789185582.939438:0:9506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789185582.948999:0:9506:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789185582.949012:0:9506:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789185582.949072:0:9506:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789185582.949125:0:9506:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789185582.949158:0:9506:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789185582.949178:0:9506:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789185582.950006:0:9506:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185582.950221:0:9506:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789185583.399302:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789185583.924518:0:9580:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185583.924882:0:9580:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789185584.423819:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185584.550347:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185584.550375:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898343424:0@lo:41: 00000100:00100000:0.0:1789185584.550461:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185584.550528:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898343424 00000100:00100000:0.0:1789185584.550548:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898343424 00000100:00100000:0.0:1789185584.550596:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789185584.550605:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898343424:12345-0@lo:41: 00000004:00000024:0.0:1789185584.550640:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789185584.550685:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898343424:12345-0@lo:41: Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185584.550693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789185584.550754:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898343424:0@lo:41: 00010000:00010000:0.0:1789185585.446128:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185586.090858:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898343552:0@lo:41: 00000100:00100000:0.0:1789185586.090970:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185586.091086:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898343552 00000100:00100000:3.0:1789185586.091097:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898343552 00000100:00100000:3.0:1789185586.091160:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789185586.091171:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898343552:12345-0@lo:41: 00000004:00000024:3.0:1789185586.091222:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789185586.091293:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898343552:12345-0@lo:41: Request processed in 123us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185586.091300:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789185586.091425:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898343552:0@lo:41: 00010000:00010000:1.0:1789185586.470545:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185587.110135:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898343680:0@lo:13: 00000100:00100000:0.0:1789185587.110226:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185587.110410:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898343808:0@lo:13: 00000100:00100000:1.0:1789185587.110412:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898343680 00000100:00100000:1.0:1789185587.110420:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898343680 00000100:00100000:2.0:1789185587.110440:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185587.110491:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898343808 00000100:00100000:1.0:1789185587.110495:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898343808 00000100:00100000:2.0:1789185587.110506:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789185587.110551:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185587.110610:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898343680:12345-0@lo:13: 00002000:00000024:2.0:1789185587.110642:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185587.110695:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898343680:12345-0@lo:13: Request processed in 180us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185587.110702:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789185587.110724:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789185587.110762:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898343808:12345-0@lo:13: 00002000:00000024:2.0:1789185587.110774:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185587.110805:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898343808:12345-0@lo:13: Request processed in 74us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185587.110810:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789185587.110866:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c2c07b80 x1876096898343680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185587.110886:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898343680:0@lo:13: 00010000:00080000:3.0:1789185587.113692:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b5c00 x1876096898343808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185587.113721:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898343808:0@lo:13: 00010000:00010000:2.0:1789185587.502366:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185588.139462:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898344064:0@lo:400: 00000100:00100000:0.0:1789185588.139534:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.139586:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898344576:0@lo:400: 00000100:00100000:0.0:1789185588.139607:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.139631:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898345088:0@lo:400: 00000100:00100000:0.0:1789185588.139650:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.139672:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789185588.139677:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898343936:0@lo:400: 00000100:00100000:0.0:1789185588.139714:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.139740:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898344448:0@lo:400: 00000100:00100000:0.0:1789185588.139763:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.139778:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898344960:0@lo:400: 00000100:00100000:0.0:1789185588.139799:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.139824:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898344192:0@lo:400: 00000100:00100000:0.0:1789185588.139845:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.139860:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898344704:0@lo:400: 00000100:00100000:0.0:1789185588.139878:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.139904:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898345216:0@lo:400: 00000100:00100000:0.0:1789185588.139954:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.139971:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789185588.139976:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898344320:0@lo:400: 00000100:00100000:0.0:1789185588.140004:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.140017:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898344832:0@lo:400: 00000100:00100000:0.0:1789185588.140035:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185588.140067:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898344064 00000100:00100000:0.0:1789185588.140075:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898344064 00000100:00100000:0.0:1789185588.140112:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898344576 00000100:00100000:0.0:1789185588.140115:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898344576 00000100:00100000:0.0:1789185588.140138:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898345088 00000100:00100000:0.0:1789185588.140141:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898345088 00000100:00100000:0.0:1789185588.140152:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898344704 00000100:00100000:0.0:1789185588.140155:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898344704 00000100:00100000:0.0:1789185588.140168:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898345216 00000100:00100000:0.0:1789185588.140170:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898345216 00000100:00100000:2.0:1789185588.140980:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898343936 00000100:00100000:2.0:1789185588.140988:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898343936 00000100:00100000:2.0:1789185588.141028:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789185588.141037:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:3636:x1876096898343936:12345-0@lo:400: 00000100:00100000:2.0:1789185588.141114:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:3636:x1876096898343936:12345-0@lo:400: Request processed in 77us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185588.141121:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789185588.141287:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898344320 00000100:00100000:0.0:1789185588.141291:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898344320 00000100:00100000:0.0:1789185588.141322:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789185588.141328:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898344064:12345-0@lo:400: 00000100:00100000:0.0:1789185588.141363:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898344064:12345-0@lo:400: Request processed in 35us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.141369:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789185588.141382:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789185588.141388:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898344576:12345-0@lo:400: 00000100:00100000:0.0:1789185588.141413:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898344576:12345-0@lo:400: Request processed in 26us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.141419:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789185588.141430:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789185588.141436:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898345088:12345-0@lo:400: 00000100:00100000:0.0:1789185588.141462:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898345088:12345-0@lo:400: Request processed in 26us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.141467:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789185588.141477:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789185588.141484:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898344704:12345-0@lo:400: 00000100:00100000:0.0:1789185588.141527:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898344704:12345-0@lo:400: Request processed in 44us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.141532:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789185588.141544:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789185588.141550:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898345216:12345-0@lo:400: 00000100:00100000:0.0:1789185588.141575:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898345216:12345-0@lo:400: Request processed in 26us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.141581:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789185588.141590:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789185588.141603:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898344320:12345-0@lo:400: 00000100:00100000:0.0:1789185588.141632:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898344320:12345-0@lo:400: Request processed in 30us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.141637:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789185588.141666:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898344448 00000100:00100000:0.0:1789185588.141669:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898344448 00000100:00100000:0.0:1789185588.141704:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898344192 00000100:00100000:0.0:1789185588.141707:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898344192 00000100:00100000:0.0:1789185588.141722:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185588.141728:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898344448:12345-0@lo:400: 00000100:00100000:0.0:1789185588.141761:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898344448:12345-0@lo:400: Request processed in 33us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.141767:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185588.141778:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185588.141784:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898344192:12345-0@lo:400: 00000100:00100000:0.0:1789185588.141810:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898344192:12345-0@lo:400: Request processed in 27us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.141815:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185588.141833:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898344960 00000100:00100000:0.0:1789185588.141836:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898344960 00000100:00100000:0.0:1789185588.141859:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898344832 00000100:00100000:0.0:1789185588.141862:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898344832 00000100:00100000:0.0:1789185588.141874:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185588.141880:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898344960:12345-0@lo:400: 00000100:00100000:0.0:1789185588.142126:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898344960:12345-0@lo:400: Request processed in 246us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.142132:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185588.142144:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185588.142157:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898344832:12345-0@lo:400: 00000100:00100000:0.0:1789185588.143353:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898344832:12345-0@lo:400: Request processed in 1191us (3310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185588.143365:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789185588.143408:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185588.143413:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185588.144551:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b0e00 x1876096898344320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185588.144567:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898344320:0@lo:400: 00010000:00080000:1.0:1789185588.144582:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b1180 x1876096898344832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185588.144591:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898344832:0@lo:400: 00000100:00100000:1.0:1789185588.144601:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898344192:0@lo:400: 00010000:00080000:1.0:1789185588.144616:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b3b80 x1876096898344704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185588.144624:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898344704:0@lo:400: 00010000:00080000:1.0:1789185588.144654:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b1880 x1876096898345216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185588.144663:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898345216:0@lo:400: 00000100:00100000:2.0:1789185588.145008:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898343936:0@lo:400: 00000100:00100000:2.0:1789185588.145022:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898344448:0@lo:400: 00010000:00080000:2.0:1789185588.145034:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b2a00 x1876096898344960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185588.145058:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898344960:0@lo:400: 00010000:00080000:2.0:1789185588.145073:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b0380 x1876096898344064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185588.145080:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898344064:0@lo:400: 00010000:00080000:2.0:1789185588.145089:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b2d80 x1876096898344576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185588.145095:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898344576:0@lo:400: 00010000:00080000:2.0:1789185588.145108:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b1500 x1876096898345088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185588.145115:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898345088:0@lo:400: 00010000:00010000:0.0:1789185588.518054:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789185589.159413:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789185589.159420:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2d26ca000 from 39 10000000:01000000:2.0:1789185589.159425:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789185589.159472:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.159485:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.159496:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185589.159518:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898345344:0@lo:101: 00000100:00100000:2.0:1789185589.159587:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.159639:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7544840 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.159704:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898345344 00000100:00100000:1.0:1789185589.159712:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898345344 00000100:00100000:1.0:1789185589.159768:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789185589.159778:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898345344:12345-0@lo:101: 00010000:00010000:1.0:1789185589.159790:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185589.159803:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72c9e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.159829:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72c9e expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.159851:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c9e expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.159860:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166c400, rc 0) 00000100:00100000:1.0:1789185589.162389:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898345344:12345-0@lo:101: Request processed in 2602us (2791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.162402:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789185589.162472:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898345344:0@lo:101: 00010000:00010000:1.0:1789185589.162496:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.162508:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185589.162604:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898345472:0@lo:501: 00000100:00100000:1.0:1789185589.162634:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.162661:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.162677:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898345472 00000100:00100000:1.0:1789185589.162683:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898345472 00000100:00100000:1.0:1789185589.162710:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789185589.162716:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898345472:12345-0@lo:501: 00000100:00100000:1.0:1789185589.162837:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898345472:12345-0@lo:501: Request processed in 121us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.162844:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789185589.162884:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898345472:0@lo:501: 00000100:00100000:1.0:1789185589.162925:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898345600:0@lo:503: 00000100:00100000:1.0:1789185589.162965:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.162977:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.162988:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898345600 00000100:00100000:1.0:1789185589.162991:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898345600 00000100:00100000:1.0:1789185589.163010:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789185589.163015:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898345600:12345-0@lo:503: 00000100:00100000:1.0:1789185589.163087:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898345600:12345-0@lo:503: Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.163093:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789185589.163128:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898345600:0@lo:503: 00000100:00100000:3.0:1789185589.170479:0:9811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9811:1876096898345728:0@lo:502: 00000100:00100000:3.0:1789185589.170574:0:9811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.170669:0:9811:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085900 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.173248:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898345728 00000100:00100000:1.0:1789185589.173262:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898345728 00000100:00100000:3.0:1789185589.179657:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789185589.179672:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9811:x1876096898345728:12345-0@lo:502: 00000100:00100000:3.0:1789185589.179879:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9811:x1876096898345728:12345-0@lo:502: Request processed in 210us (9305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.179888:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789185589.179968:0:9811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9811:1876096898345728:0@lo:502: 00000100:00100000:3.0:1789185589.180031:0:9811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9811:1876096898345856:0@lo:502: 00000100:00100000:3.0:1789185589.180071:0:9811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.180096:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898345856 00000100:00100000:3.0:1789185589.180101:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898345856 00000100:00100000:3.0:1789185589.180124:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789185589.180130:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9811:x1876096898345856:12345-0@lo:502: 00000100:00100000:3.0:1789185589.180363:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:9811:x1876096898345856:12345-0@lo:502: Request processed in 233us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.180379:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789185589.180416:0:9811:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.180427:0:9811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9811:1876096898345856:0@lo:502: 00000040:00080000:3.0:1789185589.180445:0:9811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789185589.180709:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789185589.180730:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185589.180740:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.180752:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185589.180762:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789185589.180765:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789185589.180768:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789185589.180791:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.180799:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.180820:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185589.180833:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898345984:0@lo:101: 00000100:00100000:1.0:1789185589.181160:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.181178:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.191727:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898345984 00000100:00100000:3.0:1789185589.191741:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898345984 00000100:00100000:3.0:1789185589.191794:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789185589.191804:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898345984:12345-0@lo:101: 00010000:00010000:3.0:1789185589.191823:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185589.191845:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72cac expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.191895:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72cac expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.191926:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72cac expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.191935:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da200, rc 0) 00000100:00100000:3.0:1789185589.192012:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898345984:12345-0@lo:101: Request processed in 210us (10853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.192019:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789185589.192073:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898345984:0@lo:101: 00010000:00010000:3.0:1789185589.192090:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.192101:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185589.192393:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346112:0@lo:501: 00000100:00100000:3.0:1789185589.192425:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.192791:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.194717:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898346112 00000100:00100000:1.0:1789185589.194731:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898346112 00000100:00100000:1.0:1789185589.194788:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789185589.194798:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898346112:12345-0@lo:501: 00000100:00100000:1.0:1789185589.195014:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898346112:12345-0@lo:501: Request processed in 218us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.195021:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789185589.197672:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346112:0@lo:501: 00000100:00100000:3.0:1789185589.197739:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346240:0@lo:503: 00000100:00100000:3.0:1789185589.197819:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.197882:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.198455:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898346240 00000100:00100000:1.0:1789185589.198464:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898346240 00000100:00100000:1.0:1789185589.198523:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789185589.198534:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898346240:12345-0@lo:503: 00000100:00100000:1.0:1789185589.198670:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898346240:12345-0@lo:503: Request processed in 137us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.198679:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789185589.202009:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346240:0@lo:503: 00000100:00100000:0.0:1789185589.202546:0:9814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9814:1876096898346368:0@lo:502: 00000100:00100000:0.0:1789185589.202616:0:9814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.202657:0:9814:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d33d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.202701:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898346368 00000100:00100000:3.0:1789185589.202709:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898346368 00000100:00100000:3.0:1789185589.202751:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789185589.202760:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9814:x1876096898346368:12345-0@lo:502: 00000100:00100000:3.0:1789185589.204757:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9814:x1876096898346368:12345-0@lo:502: Request processed in 1989us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.204770:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789185589.207079:0:9814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9814:1876096898346368:0@lo:502: 00000020:01000000:0.0:1789185589.207126:0:9814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185589.207149:0:9814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185589.207151:0:9814:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789185589.207157:0:9814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789185589.207158:0:9814:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789185589.207193:0:9814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9814:1876096898346496:0@lo:502: 00000100:00100000:0.0:1789185589.207269:0:9814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.207323:0:9814:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d33d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.207554:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898346496 00000100:00100000:3.0:1789185589.207562:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898346496 00000100:00100000:3.0:1789185589.207668:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789185589.207678:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9814:x1876096898346496:12345-0@lo:502: 00000100:00100000:3.0:1789185589.207808:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:9814:x1876096898346496:12345-0@lo:502: Request processed in 131us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.207816:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789185589.208679:0:9814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9814:1876096898346496:0@lo:502: 00000020:01000000:0.0:1789185589.208712:0:9814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185589.208720:0:9814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185589.208722:0:9814:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789185589.208725:0:9814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789185589.210013:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789185589.210049:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789185589.210062:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.210089:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185589.210099:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789185589.210103:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f30030e800 from 39 10000000:01000000:3.0:1789185589.210106:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789185589.210150:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.210159:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.210169:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185589.210192:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346624:0@lo:101: 00000100:00100000:3.0:1789185589.210250:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.210281:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085300 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.210451:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898346624 00000100:00100000:1.0:1789185589.210459:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898346624 00000100:00100000:1.0:1789185589.210510:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789185589.210520:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898346624:12345-0@lo:101: 00010000:00010000:1.0:1789185589.210532:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185589.210545:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72cba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.210575:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72cba expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.210585:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72cba expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.210592:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166c800, rc 0) 00000100:00100000:1.0:1789185589.210635:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898346624:12345-0@lo:101: Request processed in 116us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.210641:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789185589.210685:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346624:0@lo:101: 00010000:00010000:1.0:1789185589.210699:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.210708:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185589.210762:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346752:0@lo:501: 00000100:00100000:1.0:1789185589.210786:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.210797:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.210850:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898346752 00000100:00100000:3.0:1789185589.210855:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898346752 00000100:00100000:3.0:1789185589.210897:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789185589.210904:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898346752:12345-0@lo:501: 00000100:00100000:3.0:1789185589.211036:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898346752:12345-0@lo:501: Request processed in 132us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.211043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789185589.213043:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346752:0@lo:501: 00000100:00100000:1.0:1789185589.213099:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346880:0@lo:503: 00000100:00100000:1.0:1789185589.213168:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.213210:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.213610:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898346880 00000100:00100000:3.0:1789185589.213617:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898346880 00000100:00100000:3.0:1789185589.213668:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789185589.213684:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898346880:12345-0@lo:503: 00000100:00100000:3.0:1789185589.213787:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898346880:12345-0@lo:503: Request processed in 105us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.213794:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789185589.213890:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898346880:0@lo:503: 00000100:00100000:1.0:1789185589.214300:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9815:1876096898347008:0@lo:502: 00000100:00100000:1.0:1789185589.214346:0:9815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.214376:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.214473:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898347008 00000100:00100000:3.0:1789185589.214479:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898347008 00000100:00100000:3.0:1789185589.214513:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789185589.214521:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:9815:x1876096898347008:12345-0@lo:502: 00000100:00100000:3.0:1789185589.214606:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:9815:x1876096898347008:12345-0@lo:502: Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.214614:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789185589.214756:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9815:1876096898347008:0@lo:502: 00000100:00100000:1.0:1789185589.214797:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9815:1876096898347136:0@lo:502: 00000100:00100000:1.0:1789185589.214829:0:9815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.214873:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.214942:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898347136 00000100:00100000:3.0:1789185589.214947:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898347136 00000100:00100000:3.0:1789185589.214970:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789185589.214977:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:9815:x1876096898347136:12345-0@lo:502: 00000100:00100000:3.0:1789185589.215051:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:9815:x1876096898347136:12345-0@lo:502: Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.215058:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789185589.215165:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9815:1876096898347136:0@lo:502: 00000040:00080000:1.0:1789185589.215182:0:9815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789185589.224489:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789185589.224538:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789185589.224558:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.224571:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185589.224582:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789185589.224584:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f30030e800 from 6 10000000:01000000:3.0:1789185589.224607:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185589.224654:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.224662:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.224673:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185589.224698:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347264:0@lo:101: 00000100:00100000:3.0:1789185589.224780:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.224883:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789185589.229708:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898347264 00000100:00100000:0.0:1789185589.229723:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898347264 00000100:00100000:1.0:1789185589.229834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789185589.229844:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898347264:12345-0@lo:101: 00010000:00010000:1.0:1789185589.229873:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185589.229893:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166d200/0xda5c730d5a72ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72cc8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.229941:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166d200/0xda5c730d5a72ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72cc8 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.229953:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166d200/0xda5c730d5a72ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72cc8 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.229962:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166d200, rc 0) 00000100:00100000:1.0:1789185589.230052:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898347264:12345-0@lo:101: Request processed in 210us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.230058:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789185589.230105:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347264:0@lo:101: 00010000:00010000:1.0:1789185589.230122:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.230141:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185589.230207:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347392:0@lo:256: 00000100:00100000:1.0:1789185589.230247:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.230281:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.230480:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898347392 00000100:00100000:1.0:1789185589.230485:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898347392 00000100:00100000:1.0:1789185589.230504:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789185589.230510:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898347392:12345-0@lo:256: 20000000:01000000:1.0:1789185589.230523:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789185589.230543:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789185589.230546:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789185589.230634:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898347392:12345-0@lo:256: Request processed in 123us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.230641:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789185589.230663:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347392:0@lo:256: 10000000:01000000:1.0:1789185589.230705:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789185589.230713:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.230723:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185589.230733:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789185589.230753:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1789185589.230757:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789185589.230786:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.230793:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.230801:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185589.230813:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347520:0@lo:101: 00000100:00100000:1.0:1789185589.230838:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.230846:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.230980:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898347520 00000100:00100000:1.0:1789185589.230985:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898347520 00000100:00100000:1.0:1789185589.231001:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789185589.231006:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898347520:12345-0@lo:101: 00010000:00010000:1.0:1789185589.231014:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185589.231039:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72cd6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.231056:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72cd6 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.231065:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72cd6 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.231072:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9600, rc 0) 00000100:00100000:1.0:1789185589.231101:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898347520:12345-0@lo:101: Request processed in 94us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.231107:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789185589.231136:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347520:0@lo:101: 00010000:00010000:1.0:1789185589.231146:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.231153:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185589.231205:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347648:0@lo:501: 00000100:00100000:1.0:1789185589.231230:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.231238:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.231253:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898347648 00000100:00100000:1.0:1789185589.231256:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898347648 00000100:00100000:1.0:1789185589.231271:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789185589.231277:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898347648:12345-0@lo:501: 00000100:00100000:1.0:1789185589.232498:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898347648:12345-0@lo:501: Request processed in 1216us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.232508:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789185589.232625:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347648:0@lo:501: 00000100:00100000:2.0:1789185589.232661:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347776:0@lo:503: 00000100:00100000:2.0:1789185589.232703:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.232732:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7544840 going to sleep for 11 seconds 00000100:00100000:0.0:1789185589.232804:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898347776 00000100:00100000:0.0:1789185589.232814:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898347776 00000100:00100000:0.0:1789185589.232854:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789185589.232860:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898347776:12345-0@lo:503: 00000100:00100000:0.0:1789185589.232969:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898347776:12345-0@lo:503: Request processed in 109us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.232976:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789185589.233008:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898347776:0@lo:503: 00000100:00100000:2.0:1789185589.233279:0:9816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9816:1876096898347904:0@lo:502: 00000100:00100000:2.0:1789185589.233319:0:9816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.233343:0:9816:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185589.233478:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898347904 00000100:00100000:0.0:1789185589.233482:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898347904 00000100:00100000:0.0:1789185589.233510:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789185589.233515:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:9816:x1876096898347904:12345-0@lo:502: 00000100:00100000:0.0:1789185589.233583:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:9816:x1876096898347904:12345-0@lo:502: Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.233589:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789185589.233620:0:9816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9816:1876096898347904:0@lo:502: 00000020:01000000:0.0:1789185589.233641:0:9816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789185589.233649:0:9816:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789185589.233655:0:9816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185589.233657:0:9816:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789185589.233662:0:9816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789185589.233665:0:9816:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:01000000:0.0:1789185589.233688:0:9816:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789185589.233690:0:9816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789185589.233718:0:9816:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98f1c34b99c0) 00000020:00000080:0.0:1789185589.233746:0:9816:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789185589.233753:0:9816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789185589.233833:0:9816:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789185589.233840:0:9816:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789185589.233853:0:9816:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a72ceb 00010000:00080000:0.0:1789185589.233896:0:9816:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c3109800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.148@tcp at head 00010000:00010000:0.0:1789185589.234141:0:9816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789185589.234250:0:9816:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789185589.234261:0:9816:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789185589.234628:0:9816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185589.234739:0:9816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185589.234895:0:9816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789185589.235055:0:9816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789185589.235614:0:9817:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185589.235619:0:9817:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789185589.236363:0:9816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789185589.236375:0:9816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789185589.236416:0:9816:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789185589.236441:0:9816:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a72cf2 00000100:00080000:0.0:1789185589.236451:0:9816:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789185589.236463:0:9816:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f1c3109800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185589.236498:0:9816:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b7480 x1876096898348032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185589.236558:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898348032:0@lo:8: 00000100:00100000:2.0:1789185589.236634:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.236716:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898348032 00000100:00100000:3.0:1789185589.236724:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898348032 00000100:00100000:3.0:1789185589.236760:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185589.236767:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876096898348032:12345-0@lo:8: 00010000:00080000:3.0:1789185589.236791:0:8429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1789185589.236815:0:8429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a72cf9 00002000:00100000:3.0:1789185589.236825:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98f1c316c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789185589.236829:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1789185589.236833:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789185589.236895:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789185589.237113:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789185589.237138:0:8429:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789185589.237225:0:9816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789185589.237353:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898348160:0@lo:400: 00000100:00100000:0.0:1789185589.237388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.237408:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898348672:0@lo:400: 00000100:00100000:0.0:1789185589.237426:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.237442:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898349184:0@lo:400: 00000100:00100000:0.0:1789185589.237474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.237494:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789185589.237500:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898348544:0@lo:400: 00000100:00100000:0.0:1789185589.237521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.237536:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898349056:0@lo:400: 00000100:00100000:0.0:1789185589.237564:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.237596:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898348160 00000100:00100000:0.0:1789185589.237600:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898348160 00000100:00100000:0.0:1789185589.237630:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898348672 00000100:00100000:0.0:1789185589.237632:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898348672 00000100:00100000:0.0:1789185589.237648:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898349184 00000100:00100000:0.0:1789185589.237650:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898349184 00000100:00100000:0.0:1789185589.237662:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185589.237669:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898348160:12345-0@lo:400: 00000100:00100000:0.0:1789185589.237706:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898348160:12345-0@lo:400: Request processed in 37us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.237714:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185589.237728:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789185589.237734:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898348672:12345-0@lo:400: 00000100:00100000:0.0:1789185589.237758:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898348672:12345-0@lo:400: Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.237764:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789185589.237775:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789185589.237781:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898349184:12345-0@lo:400: 00000100:00100000:0.0:1789185589.237803:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898349184:12345-0@lo:400: Request processed in 22us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.237808:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789185589.237830:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898348544 00000100:00100000:0.0:1789185589.237834:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898348544 00000100:00100000:0.0:1789185589.237856:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789185589.237874:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898348544:12345-0@lo:400: 00000100:00100000:0.0:1789185589.237904:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898348544:12345-0@lo:400: Request processed in 42us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.237936:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789185589.237956:0:8430:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789185589.237963:0:8430:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789185589.238005:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898348544:0@lo:400: 00010000:00080000:0.0:1789185589.238018:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b4700 x1876096898348160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185589.238027:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898348160:0@lo:400: 00010000:00080000:0.0:1789185589.238036:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b6680 x1876096898348672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185589.238043:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898348672:0@lo:400: 00010000:00080000:0.0:1789185589.238050:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b7b80 x1876096898349184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185589.238057:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898349184:0@lo:400: 00000020:01000000:0.0:1789185589.238132:0:9816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185589.238138:0:9816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185589.238141:0:9816:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789185589.238144:0:9816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185589.238148:0:9816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185589.238149:0:9816:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789185589.238152:0:9816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789185589.238154:0:9816:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789185589.238178:0:9816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9816:1876096898349440:0@lo:502: 00000100:00100000:0.0:1789185589.238215:0:9816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.238237:0:9816:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.241539:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898348288:0@lo:400: 00000100:00100000:1.0:1789185589.241645:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.241686:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898348800:0@lo:400: 00000100:00100000:1.0:1789185589.241713:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.241735:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898349312:0@lo:400: 00000100:00100000:1.0:1789185589.241754:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.241776:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789185589.241782:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898348416:0@lo:400: 00000100:00100000:1.0:1789185589.241802:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.241842:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898348928:0@lo:400: 00000100:00100000:1.0:1789185589.241888:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.241969:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898348288 00000100:00100000:1.0:1789185589.241976:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898348288 00000100:00100000:1.0:1789185589.242023:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185589.242034:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898348288:12345-0@lo:400: 00000100:00100000:1.0:1789185589.242094:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898348288:12345-0@lo:400: Request processed in 62us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.242100:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185589.242123:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898348800 00000100:00100000:1.0:1789185589.242126:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898348800 00000100:00100000:1.0:1789185589.242152:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898349312 00000100:00100000:1.0:1789185589.242156:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898349312 00000100:00100000:1.0:1789185589.242172:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898348416 00000100:00100000:1.0:1789185589.242174:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898348416 00000100:00100000:1.0:1789185589.242189:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185589.242195:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898348800:12345-0@lo:400: 00000100:00100000:1.0:1789185589.242225:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898348800:12345-0@lo:400: Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.242231:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185589.242244:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789185589.242249:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898349312:12345-0@lo:400: 00000100:00100000:1.0:1789185589.242273:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898349312:12345-0@lo:400: Request processed in 24us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.242279:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789185589.243050:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789185589.243063:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898348416:12345-0@lo:400: 00000100:00100000:1.0:1789185589.243110:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898348416:12345-0@lo:400: Request processed in 52us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.243129:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789185589.243165:0:8427:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789185589.243174:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898349056 00000100:00100000:1.0:1789185589.243179:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898349056 00000100:00100000:1.0:1789185589.243215:0:8427:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789185589.243221:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898348928 00000100:00100000:1.0:1789185589.243224:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898348928 00000100:00100000:1.0:1789185589.243236:0:8427:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789185589.243242:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185589.243248:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898349056:12345-0@lo:400: 00000100:00100000:1.0:1789185589.243437:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898349056:12345-0@lo:400: Request processed in 37us (5720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.243445:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185589.243459:0:8427:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789185589.243465:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789185589.243472:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898348928:12345-0@lo:400: 00000100:00100000:1.0:1789185589.243502:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898348928:12345-0@lo:400: Request processed in 31us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.243509:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789185589.243551:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b5f80 x1876096898348416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185589.243567:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898348416:0@lo:400: 00010000:00080000:1.0:1789185589.243579:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b6300 x1876096898348928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185589.243585:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898348928:0@lo:400: 00000100:00100000:1.0:1789185589.243595:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898348288:0@lo:400: 00010000:00080000:1.0:1789185589.243616:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b4e00 x1876096898348800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185589.243623:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898348800:0@lo:400: 00010000:00080000:1.0:1789185589.243634:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b5180 x1876096898349312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185589.243641:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898349312:0@lo:400: 00000100:00080000:1.0:1789185589.243685:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185589.243705:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b6d80 x1876096898349056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185589.243714:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898349056:0@lo:400: 00000100:00100000:3.0:1789185589.244326:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1876096898348032:12345-0@lo:8: Request processed in 7554us (7687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.244336:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789185589.244476:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b7480 x1876096898348032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.244486:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789185589.244494:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789185589.244502:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789185589.244508:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789185589.244511:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c3109800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789185589.244536:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789185589.244542:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898348032:0@lo:8: 00000100:00100000:2.0:1789185589.244655:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898349440 00000100:00100000:2.0:1789185589.244661:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898349440 00000100:00100000:2.0:1789185589.244695:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789185589.244702:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:9816:x1876096898349440:12345-0@lo:502: 00000100:00100000:2.0:1789185589.244824:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:9816:x1876096898349440:12345-0@lo:502: Request processed in 121us (6606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.244839:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789185589.245150:0:9818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9818:1876096898349568:0@lo:700: 00000100:00100000:3.0:1789185589.245189:0:9818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.245221:0:9818:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185589.245368:0:9816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9816:1876096898349440:0@lo:502: 00000020:01000000:0.0:1789185589.245405:0:9816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185589.245413:0:9816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185589.245415:0:9816:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789185589.245420:0:9816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1789185589.245482:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1789185589.245503:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789185589.245514:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185589.245526:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185589.245536:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789185589.245539:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2e7ae1000 from 39 10000000:01000000:0.0:1789185589.245542:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789185589.245565:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185589.245574:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185589.245583:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185589.245595:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898349696:0@lo:101: 00000100:00100000:0.0:1789185589.245624:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.245645:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d330c0 going to sleep for 11 seconds 00000004:00080000:0.0:1789185589.245659:0:9817:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789185589.245715:0:9817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 228407806413ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789185589.245722:0:9817:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789185589.245952:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898349696 00000100:00100000:3.0:1789185589.245958:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898349696 00000100:00100000:3.0:1789185589.245988:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789185589.245995:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898349696:12345-0@lo:101: 00010000:00010000:3.0:1789185589.246007:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185589.246020:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72d00 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.246042:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72d00 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.246052:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72d00 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.246060:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dbe00, rc 0) 00000100:00100000:3.0:1789185589.246089:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898349696:12345-0@lo:101: Request processed in 95us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.246094:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789185589.246122:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898349696:0@lo:101: 00010000:00010000:3.0:1789185589.246133:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.246141:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185589.246187:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898349824:0@lo:501: 00000100:00100000:3.0:1789185589.246218:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.246234:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.246901:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898349568 00000100:00100000:2.0:1789185589.246918:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898349568 00000100:00100000:2.0:1789185589.246966:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185589.246974:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9818:x1876096898349568:12345-0@lo:700: 00000100:00100000:2.0:1789185589.247006:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8437:1876096898349952:0@lo:700: 00000100:00100000:2.0:1789185589.247036:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.247055:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.247068:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898349824 00000100:00100000:2.0:1789185589.247072:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898349824 00000100:00100000:2.0:1789185589.247097:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789185589.247103:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898349824:12345-0@lo:501: 00000100:00100000:2.0:1789185589.247217:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898349824:12345-0@lo:501: Request processed in 112us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.247224:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789185589.247252:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898349952 00000100:00100000:2.0:1789185589.247255:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898349952 00000100:00100000:2.0:1789185589.247277:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185589.247282:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8437:x1876096898349952:12345-0@lo:700: 00000100:00100000:3.0:1789185589.247586:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898349824:0@lo:501: 00000100:00100000:3.0:1789185589.247615:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350080:0@lo:503: 00000100:00100000:3.0:1789185589.247657:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.247677:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.248222:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898350080 00000100:00100000:2.0:1789185589.248228:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898350080 00000100:00100000:2.0:1789185589.248381:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789185589.248390:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898350080:12345-0@lo:503: 00000100:00100000:2.0:1789185589.248497:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898350080:12345-0@lo:503: Request processed in 108us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.248504:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1789185589.249005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789185589.253839:0:7444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789185589.254050:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350080:0@lo:503: 00000100:00100000:3.0:1789185589.264698:0:9820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9820:1876096898350208:0@lo:502: 00000100:00100000:3.0:1789185589.264807:0:9820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.265048:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898350208 00000100:00100000:0.0:1789185589.265058:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898350208 00000100:00100000:0.0:1789185589.265110:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789185589.265119:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:9820:x1876096898350208:12345-0@lo:502: 00000100:00100000:0.0:1789185589.265238:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:9820:x1876096898350208:12345-0@lo:502: Request processed in 120us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.265245:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789185589.266132:0:9820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.266166:0:9820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9820:1876096898350208:0@lo:502: 00000100:00100000:3.0:1789185589.266235:0:9820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9820:1876096898350336:0@lo:502: 00000100:00100000:3.0:1789185589.266281:0:9820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.266418:0:9820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.268806:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898350336 00000100:00100000:2.0:1789185589.268823:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898350336 00000100:00100000:2.0:1789185589.268926:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789185589.268939:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:9820:x1876096898350336:12345-0@lo:502: 00000100:00100000:2.0:1789185589.269114:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:9820:x1876096898350336:12345-0@lo:502: Request processed in 177us (2831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.269121:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789185589.269186:0:9820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9820:1876096898350336:0@lo:502: 00000040:00080000:2.0:1789185589.269218:0:9820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789185589.269627:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789185589.269649:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185589.269660:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.269671:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185589.269681:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789185589.269684:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f2e7ae1000 from 6 10000000:01000000:1.0:1789185589.269687:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789185589.269719:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.269728:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185589.269751:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185589.269770:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350464:0@lo:101: 00000100:00100000:1.0:1789185589.269809:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.269837:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.271603:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898350464 00000100:00100000:2.0:1789185589.271613:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898350464 00000100:00100000:2.0:1789185589.271655:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789185589.271662:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898350464:12345-0@lo:101: 00010000:00010000:2.0:1789185589.271676:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185589.271691:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72d0e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.271716:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72d0e expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.271727:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72d0e expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.271735:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddee00, rc 0) 00000100:00100000:2.0:1789185589.271801:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898350464:12345-0@lo:101: Request processed in 138us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.271807:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789185589.271859:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350464:0@lo:101: 00010000:00010000:2.0:1789185589.271895:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.271904:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185589.271973:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350592:0@lo:256: 00000100:00100000:2.0:1789185589.272007:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.272033:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.272045:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898350592 00000100:00100000:2.0:1789185589.272048:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898350592 00000100:00100000:2.0:1789185589.272063:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789185589.272068:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898350592:12345-0@lo:256: 20000000:01000000:2.0:1789185589.272081:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789185589.272097:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789185589.272099:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789185589.272175:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898350592:12345-0@lo:256: Request processed in 106us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.272182:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789185589.272206:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350592:0@lo:256: 10000000:01000000:2.0:1789185589.272245:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789185589.272251:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.272259:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185589.272267:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789185589.272273:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789185589.272276:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789185589.272294:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.272302:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.272309:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185589.272320:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350720:0@lo:101: 00000100:00100000:2.0:1789185589.272343:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.272356:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.272373:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898350720 00000100:00100000:2.0:1789185589.272376:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898350720 00000100:00100000:2.0:1789185589.272393:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789185589.272398:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898350720:12345-0@lo:101: 00010000:00010000:2.0:1789185589.272405:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185589.272412:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72d1c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.272425:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72d1c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.272431:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72d1c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.272437:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde000, rc 0) 00000100:00100000:2.0:1789185589.272460:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898350720:12345-0@lo:101: Request processed in 62us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.272471:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789185589.272497:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350720:0@lo:101: 00010000:00010000:2.0:1789185589.272506:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.272513:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185589.272556:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350848:0@lo:501: 00000100:00100000:2.0:1789185589.272579:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.272590:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.272600:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898350848 00000100:00100000:2.0:1789185589.272602:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898350848 00000100:00100000:2.0:1789185589.272616:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789185589.272621:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898350848:12345-0@lo:501: 00000100:00100000:2.0:1789185589.272710:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898350848:12345-0@lo:501: Request processed in 89us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.272716:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789185589.272739:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350848:0@lo:501: 00000100:00100000:2.0:1789185589.272761:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350976:0@lo:503: 00000100:00100000:2.0:1789185589.272797:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.272808:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f75b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.272818:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898350976 00000100:00100000:2.0:1789185589.272821:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898350976 00000100:00100000:2.0:1789185589.272835:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789185589.272840:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898350976:12345-0@lo:503: 00000100:00100000:2.0:1789185589.272944:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898350976:12345-0@lo:503: Request processed in 102us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.272950:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789185589.272985:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898350976:0@lo:503: 40000000:02000000:3.0:1789185589.276209:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1789185589.284354:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8437:x1876096898349952:12345-0@lo:700: Request processed in 37063us (37308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.284376:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185589.284547:0:9821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9821:1876096898351104:0@lo:502: 00000100:00100000:3.0:1789185589.284611:0:9821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.284647:0:9821:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5600 going to sleep for 11 seconds 00010000:00080000:2.0:1789185589.285229:0:8437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ee300 x1876096898349952/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.285244:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8437:1876096898349952:0@lo:700: 40000000:02000000:2.0:1789185589.285255:0:8437:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1789185589.299127:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898351104 00000100:00100000:2.0:1789185589.299141:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898351104 00000100:00100000:2.0:1789185589.299189:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789185589.299198:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:9821:x1876096898351104:12345-0@lo:502: 00000100:00100000:2.0:1789185589.299380:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:9821:x1876096898351104:12345-0@lo:502: Request processed in 182us (14769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.299388:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789185589.299454:0:9821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9821:1876096898351104:0@lo:502: 00000020:01000000:2.0:1789185589.299484:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789185589.299491:0:9821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789185589.299498:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185589.299500:0:9821:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789185589.299505:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789185589.299509:0:9821:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:01000000:2.0:1789185589.299530:0:9821:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789185589.299533:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185589.299556:0:9821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98f1c34e8000) 00000020:00000080:2.0:1789185589.299580:0:9821:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1789185589.299591:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789185589.299681:0:9821:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789185589.299687:0:9821:0:(osd_handler.c:8926:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789185589.299694:0:9821:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a72d31 00010000:00080000:2.0:1789185589.299723:0:9821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f2c3eb7800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.148@tcp at head 00010000:00010000:2.0:1789185589.299999:0:9821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000001:00100000:3.0:1789185589.304963:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789185589.305146:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9818:x1876096898349568:12345-0@lo:700: Request processed in 58168us (59950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.305160:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789185589.305301:0:9818:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b4a80 x1876096898349568/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185589.305316:0:9818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9818:1876096898349568:0@lo:700: 00000040:01000000:2.0:1789185589.305830:0:9821:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789185589.305844:0:9821:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789185589.306211:0:9821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185589.306344:0:9821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185589.306490:0:9821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789185589.306588:0:9821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789185589.308272:0:9822:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185589.308285:0:9822:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789185589.313086:0:9821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789185589.313106:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789185589.313153:0:9821:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789185589.313181:0:9821:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a72d38 00000100:00080000:3.0:1789185589.313193:0:9821:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185589.313206:0:9821:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f2c3eb7800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185589.313247:0:9821:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b4a80 x1876096898351232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185589.313268:0:9821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789185589.313352:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185589.313357:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185589.313359:0:9821:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789185589.313362:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185589.313365:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185589.313367:0:9821:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789185589.313370:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789185589.313372:0:9821:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789185589.313399:0:9821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9821:1876096898351360:0@lo:502: 00000100:00100000:3.0:1789185589.313498:0:9821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.313537:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898351360 00000100:00100000:3.0:1789185589.313544:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898351360 00000100:00100000:3.0:1789185589.313591:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789185589.313600:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:9821:x1876096898351360:12345-0@lo:502: 00000100:00100000:3.0:1789185589.313714:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:9821:x1876096898351360:12345-0@lo:502: Request processed in 113us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.313721:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789185589.313770:0:9821:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.313789:0:9821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:9821:1876096898351360:0@lo:502: 00000020:01000000:3.0:1789185589.313817:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185589.313821:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185589.313823:0:9821:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789185589.313827:0:9821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:2.0:1789185589.314023:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898351232:0@lo:8: 00000100:00100000:2.0:1789185589.314066:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789185589.314099:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1789185589.314119:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789185589.314127:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.314139:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185589.314149:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789185589.314152:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98f2c6fd4d40 from 1 10000000:01000000:2.0:1789185589.314155:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789185589.314179:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.314186:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185589.314207:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185589.314219:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898351488:0@lo:101: 00000100:00100000:2.0:1789185589.314246:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.314267:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.314316:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898351488 00000100:00100000:3.0:1789185589.314321:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898351488 00000100:00100000:3.0:1789185589.314355:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789185589.314363:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898351488:12345-0@lo:101: 00010000:00010000:3.0:1789185589.314371:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185589.314383:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72d3f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.314407:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72d3f expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.314417:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72d3f expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.314426:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db600, rc 0) 00000100:00100000:3.0:1789185589.314459:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898351488:12345-0@lo:101: Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.314466:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789185589.314498:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898351488:0@lo:101: 00010000:00010000:3.0:1789185589.314511:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.314520:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185589.314577:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898351616:0@lo:501: 00000100:00100000:3.0:1789185589.314602:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.314616:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185589.314626:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898351616 00000100:00100000:3.0:1789185589.314629:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898351616 00000100:00100000:3.0:1789185589.314652:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789185589.314658:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898351616:12345-0@lo:501: 00000100:00100000:3.0:1789185589.314716:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898351616:12345-0@lo:501: Request processed in 57us (113us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185589.314723:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789185589.314747:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898351616:0@lo:501: 10000000:01000000:3.0:1789185589.314764:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789185589.314768:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185589.314775:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185589.315057:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898351232 00000100:00100000:1.0:1789185589.315063:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898351232 00000100:00100000:1.0:1789185589.315096:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185589.315102:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898351232:12345-0@lo:8: 00010000:00080000:1.0:1789185589.315130:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1789185589.315160:0:8427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a72d4d 00002000:00100000:1.0:1789185589.315175:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98f1c30f8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789185589.315179:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789185589.315182:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789185589.315260:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789185589.315282:0:8427:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185589.315336:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1876096898351232:12345-0@lo:8: Request processed in 232us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.315343:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789185589.315652:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b4a80 x1876096898351232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.315664:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789185589.315671:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789185589.315678:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789185589.315683:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789185589.315686:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c3eb7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789185589.315698:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789185589.315703:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898351232:0@lo:8: 00000004:00080000:3.0:1789185589.316044:0:9822:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789185589.316093:0:9822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 228478184200ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789185589.316098:0:9822:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789185589.318619:0:9818:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789185589.318653:0:9818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9818:1876096898351872:0@lo:7: 00000100:00100000:1.0:1789185589.318720:0:9818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185589.318763:0:9818:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.318785:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898351872 00000100:00100000:1.0:1789185589.318792:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898351872 00000100:00100000:1.0:1789185589.318847:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789185589.318955:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898351744:0@lo:13: 00000100:00100000:2.0:1789185589.318985:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.319061:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898351744 00000100:00100000:3.0:1789185589.319066:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898351744 00000100:00100000:3.0:1789185589.319105:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185589.319113:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898351744:12345-0@lo:13: 00002000:00000024:3.0:1789185589.319140:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789185589.319193:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898351744:12345-0@lo:13: Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185589.319200:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789185589.319240:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b2d80 x1876096898351744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185589.319259:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898351744:0@lo:13: 00000100:00100000:1.0:1789185589.319346:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9818:x1876096898351872:12345-0@lo:7: 00000004:00080000:2.0:1789185589.321076:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789185589.321160:0:9823:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789185589.321182:0:9823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1876096898352128:0@lo:7: 00000100:00100000:2.0:1789185589.321233:0:9823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.321258:0:9823:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185589.323705:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185589.323728:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898352000:0@lo:13: 00000100:00100000:0.0:1789185589.323795:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.323904:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898352000 00000100:00100000:2.0:1789185589.323934:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898352000 00000100:00100000:2.0:1789185589.324000:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789185589.324009:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898352000:12345-0@lo:13: 00002000:00000024:2.0:1789185589.324043:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789185589.324092:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898352000:12345-0@lo:13: Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.324099:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789185589.324313:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789185589.324345:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ee680 x1876096898352000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185589.324365:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898352000:0@lo:13: 00000100:00100000:0.0:1789185589.325539:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898352128 00000100:00100000:0.0:1789185589.325551:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898352128 00000100:00100000:0.0:1789185589.325596:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185589.325605:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9823:x1876096898352128:12345-0@lo:7: 00002000:00080000:1.0:1789185589.328272:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789185589.328282:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789185589.328383:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9818:x1876096898351872:12345-0@lo:7: Request processed in 9037us (9659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185589.328393:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789185589.331595:0:9818:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b0380 x1876096898351872/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.331613:0:9818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9818:1876096898351872:0@lo:7: 00000004:00080000:2.0:1789185589.331627:0:9818:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789185589.331672:0:9818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9818:1876096898352256:0@lo:5: 00000100:00100000:2.0:1789185589.331732:0:9818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.331774:0:9818:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185589.331799:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898352256 00000100:00100000:2.0:1789185589.331806:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898352256 00000100:00100000:2.0:1789185589.331878:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789185589.331889:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9818:x1876096898352256:12345-0@lo:5: 00002000:00080000:2.0:1789185589.331934:0:9819:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789185589.331977:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9818:x1876096898352256:12345-0@lo:5: Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.331984:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789185589.332014:0:9818:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ec700 x1876096898352256/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.332023:0:9818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9818:1876096898352256:0@lo:5: 00000004:00080000:2.0:1789185589.332031:0:9818:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789185589.332051:0:9818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9818:1876096898352384:0@lo:5: 00000100:00100000:2.0:1789185589.332072:0:9818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.332096:0:9818:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.334092:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898352384 00000100:00100000:1.0:1789185589.334105:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898352384 00000100:00100000:1.0:1789185589.334193:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185589.334203:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9818:x1876096898352384:12345-0@lo:5: 00002000:00080000:1.0:1789185589.334264:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1789185589.339482:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9818:x1876096898352384:12345-0@lo:5: Request processed in 5274us (7402us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789185589.339493:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789185589.341074:0:9818:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ec700 x1876096898352384/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.341095:0:9818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9818:1876096898352384:0@lo:5: 00000004:00080000:2.0:1789185589.341111:0:9818:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789185589.341155:0:9818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9818:1876096898352512:0@lo:900: 00000100:00100000:2.0:1789185589.341203:0:9818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.341235:0:9818:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789185589.343819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898352512 00000100:00100000:0.0:1789185589.343832:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898352512 00000100:00100000:0.0:1789185589.343931:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185589.343942:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9818:x1876096898352512:12345-0@lo:900: 00000100:00100000:0.0:1789185589.344050:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9818:x1876096898352512:12345-0@lo:900: Request processed in 110us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.344058:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:0.0:1789185589.344693:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789185589.344698:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789185589.344756:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9823:x1876096898352128:12345-0@lo:7: Request processed in 19151us (23522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.344764:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789185589.344898:0:9818:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ee680 x1876096898352512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.344934:0:9818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9818:1876096898352512:0@lo:900: 00010000:00080000:2.0:1789185589.345000:0:9823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ec380 x1876096898352128/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.345009:0:9823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1876096898352128:0@lo:7: 00000004:00080000:2.0:1789185589.345016:0:9823:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789185589.345046:0:9823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1876096898352640:0@lo:5: 00000100:00100000:2.0:1789185589.345076:0:9823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.345102:0:9823:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185589.345624:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898352640 00000100:00100000:0.0:1789185589.345631:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898352640 00000100:00100000:0.0:1789185589.345705:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789185589.345714:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9823:x1876096898352640:12345-0@lo:5: 00002000:00080000:0.0:1789185589.345735:0:9819:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789185589.345738:0:9819:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789185589.353630:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1789185589.353656:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789185589.353665:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789185589.353890:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9823:x1876096898352640:12345-0@lo:5: Request processed in 8172us (8807us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789185589.353902:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789185589.354122:0:9823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ec380 x1876096898352640/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185589.354134:0:9823:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789185589.354140:0:9823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1876096898352640:0@lo:5: 00000004:00080000:3.0:1789185589.354156:0:9823:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789185589.354207:0:9823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1876096898352768:0@lo:700: 00000100:00100000:3.0:1789185589.354246:0:9823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185589.354289:0:9823:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.355226:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898352768 00000100:00100000:1.0:1789185589.355235:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898352768 00000100:00100000:1.0:1789185589.355285:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789185589.355294:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9823:x1876096898352768:12345-0@lo:700: 00000100:00100000:2.0:1789185589.365761:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9823:x1876096898352768:12345-0@lo:700: Request processed in 10458us (11505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185589.365778:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789185589.365876:0:9823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b7b80 x1876096898352768/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185589.365891:0:9823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1876096898352768:0@lo:700: 00000004:02000040:0.0:1789185589.368206:0:9823:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1789185589.372757:0:9823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1876096898352896:0@lo:5: 00000100:00100000:2.0:1789185589.375871:0:9823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185589.375952:0:9823:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185589.376092:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898352896 00000100:00100000:1.0:1789185589.376102:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898352896 00000100:00100000:1.0:1789185589.376159:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185589.376169:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9823:x1876096898352896:12345-0@lo:5: 00002000:00080000:1.0:1789185589.382184:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789185589.382205:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1789185589.384136:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9823:x1876096898352896:12345-0@lo:5: Request processed in 7962us (8281us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789185589.384148:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789185589.384377:0:9823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b4700 x1876096898352896/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185605 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185589.384394:0:9823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1876096898352896:0@lo:5: 00000004:00080000:2.0:1789185589.384418:0:9823:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1789185589.542060:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185589.670039:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185589.670065:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898353024:0@lo:41: 00000100:00100000:0.0:1789185589.670143:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185589.670216:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898353024 00000100:00100000:0.0:1789185589.670224:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898353024 00000100:00100000:0.0:1789185589.670271:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789185589.670290:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898353024:12345-0@lo:41: 00000004:00000024:0.0:1789185589.670330:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789185589.670378:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898353024:12345-0@lo:41: Request processed in 98us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185589.670385:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789185589.670431:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898353024:0@lo:41: 00000001:02000400:0.0:1789185590.352253:0:9881:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789185590.570144:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185591.206558:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185591.206601:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898353152:0@lo:41: 00000100:00100000:3.0:1789185591.206704:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185591.211544:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898353152 00000100:00100000:1.0:1789185591.211567:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898353152 00000100:00100000:1.0:1789185591.211645:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789185591.211658:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898353152:12345-0@lo:41: 00000004:00000024:1.0:1789185591.211709:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185591.211845:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898353152:12345-0@lo:41: Request processed in 189us (5141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185591.211853:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185591.217278:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898353152:0@lo:41: 00010000:00010000:2.0:1789185591.590082:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789185591.599558:0:9933:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185591.599798:0:9933:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789185592.235841:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898353280:0@lo:13: 00000100:00100000:0.0:1789185592.235946:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185592.236043:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898353408:0@lo:13: 00000100:00100000:0.0:1789185592.236068:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185592.236106:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898353280 00000100:00100000:0.0:1789185592.236114:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898353280 00000100:00100000:2.0:1789185592.236124:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898353408 00000100:00100000:2.0:1789185592.236129:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898353408 00000100:00100000:0.0:1789185592.236177:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789185592.236186:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898353280:12345-0@lo:13: 00002000:00000024:0.0:1789185592.236218:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185592.236260:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898353280:12345-0@lo:13: Request processed in 75us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185592.236267:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789185592.236298:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789185592.236304:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898353408:12345-0@lo:13: 00002000:00000024:0.0:1789185592.236314:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185592.236340:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898353408:12345-0@lo:13: Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185592.236346:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789185592.242003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185592.242070:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f270aa00 x1876096898353408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185592.242094:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898353408:0@lo:13: 00010000:00080000:2.0:1789185592.242133:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f2708e00 x1876096898353280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185592.242145:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898353280:0@lo:13: 00010000:00010000:0.0:1789185592.614031:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789185592.683979:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1789185593.640209:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185594.664197:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185594.792327:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898353536:0@lo:400: 00000100:00100000:3.0:1789185594.792400:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792448:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898354048:0@lo:400: 00000100:00100000:3.0:1789185594.792483:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792502:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898354560:0@lo:400: 00000100:00100000:3.0:1789185594.792524:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792541:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898355072:0@lo:400: 00000100:00100000:3.0:1789185594.792559:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792582:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789185594.792589:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898353920:0@lo:400: 00000100:00100000:3.0:1789185594.792610:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792628:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898354432:0@lo:400: 00000100:00100000:3.0:1789185594.792646:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792662:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898354944:0@lo:400: 00000100:00100000:3.0:1789185594.792679:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792706:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898353792:0@lo:400: 00000100:00100000:3.0:1789185594.792726:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792741:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898354304:0@lo:400: 00000100:00100000:3.0:1789185594.792771:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792788:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898354816:0@lo:400: 00000100:00100000:3.0:1789185594.792812:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792829:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789185594.792834:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898353664:0@lo:400: 00000100:00100000:3.0:1789185594.792853:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792868:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898354176:0@lo:400: 00000100:00100000:3.0:1789185594.792898:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792937:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898354688:0@lo:400: 00000100:00100000:3.0:1789185594.792960:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185594.792993:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898353536 00000100:00100000:3.0:1789185594.793002:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898353536 00000100:00100000:3.0:1789185594.793050:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789185594.793060:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898353536:12345-0@lo:400: 00000100:00100000:0.0:1789185594.793723:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898354048 00000100:00100000:0.0:1789185594.793729:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898354048 00000100:00100000:0.0:1789185594.793774:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898353792 00000100:00100000:0.0:1789185594.793778:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898353792 00000100:00100000:0.0:1789185594.793793:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789185594.793800:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898354048:12345-0@lo:400: 00000100:00100000:0.0:1789185594.793850:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898354048:12345-0@lo:400: Request processed in 50us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.793857:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789185594.793893:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789185594.793899:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898353792:12345-0@lo:400: 00000100:00100000:0.0:1789185594.793945:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898353792:12345-0@lo:400: Request processed in 46us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.793951:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789185594.794025:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898355200:0@lo:41: 00000100:00100000:0.0:1789185594.794054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185594.794073:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185594.794078:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898355328:0@lo:13: 00000100:00100000:0.0:1789185594.794101:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185594.794126:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898355200 00000100:00100000:0.0:1789185594.794130:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898355200 00000100:00100000:0.0:1789185594.794147:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789185594.794153:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898355200:12345-0@lo:41: 00000004:00000024:0.0:1789185594.794178:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789185594.794212:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898355200:12345-0@lo:41: Request processed in 59us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.794225:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789185594.794244:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898355328 00000100:00100000:0.0:1789185594.794247:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898355328 00000100:00100000:0.0:1789185594.794275:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789185594.794281:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898355328:12345-0@lo:13: 00002000:00000024:0.0:1789185594.794299:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185594.794326:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898355328:12345-0@lo:13: Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.794331:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789185594.794367:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b5180 x1876096898355328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185594.794377:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789185594.794396:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898355328:0@lo:13: 00000100:00100000:0.0:1789185594.794407:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898355200:0@lo:41: 00000100:00080000:0.0:1789185594.794422:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185594.794442:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898353792:0@lo:400: 00000100:00100000:0.0:1789185594.794484:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898353920 00000100:00100000:0.0:1789185594.794488:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898353920 00000100:00100000:0.0:1789185594.794507:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898354304 00000100:00100000:0.0:1789185594.794510:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898354304 00000100:00100000:0.0:1789185594.794525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898354816 00000100:00100000:0.0:1789185594.794527:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898354816 00000100:00100000:0.0:1789185594.794537:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898353664 00000100:00100000:0.0:1789185594.794539:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898353664 00000100:00100000:0.0:1789185594.794548:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898354176 00000100:00100000:0.0:1789185594.794550:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898354176 00000100:00100000:0.0:1789185594.794559:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898354688 00000100:00100000:0.0:1789185594.794568:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898354688 00000100:00100000:0.0:1789185594.794584:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789185594.794590:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898353920:12345-0@lo:400: 00000100:00100000:0.0:1789185594.794624:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898353920:12345-0@lo:400: Request processed in 34us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.794630:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789185594.794645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789185594.794651:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898354304:12345-0@lo:400: 00000100:00100000:0.0:1789185594.794682:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898354304:12345-0@lo:400: Request processed in 31us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.794687:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789185594.794704:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789185594.794710:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898354816:12345-0@lo:400: 00000100:00100000:0.0:1789185594.794735:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898354816:12345-0@lo:400: Request processed in 25us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.794741:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789185594.794752:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185594.794776:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898353664:12345-0@lo:400: 00000100:00100000:0.0:1789185594.794803:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898353664:12345-0@lo:400: Request processed in 46us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.794809:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185594.794823:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185594.794828:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898354176:12345-0@lo:400: 00000100:00100000:0.0:1789185594.794853:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898354176:12345-0@lo:400: Request processed in 26us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.794859:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185594.794879:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789185594.794886:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898354688:12345-0@lo:400: 00000100:00100000:0.0:1789185594.794935:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898354688:12345-0@lo:400: Request processed in 50us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.794942:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789185594.794966:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898354560 00000100:00100000:0.0:1789185594.794971:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898354560 00000100:00100000:0.0:1789185594.794989:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898355072 00000100:00100000:0.0:1789185594.794992:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898355072 00000100:00100000:0.0:1789185594.795001:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898354432 00000100:00100000:0.0:1789185594.795004:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898354432 00000100:00100000:0.0:1789185594.795013:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898354944 00000100:00100000:0.0:1789185594.795016:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898354944 00000100:00100000:0.0:1789185594.795030:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185594.795036:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898354560:12345-0@lo:400: 00000100:00100000:0.0:1789185594.795066:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898354560:12345-0@lo:400: Request processed in 31us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.795072:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185594.795085:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789185594.795091:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898355072:12345-0@lo:400: 00000100:00100000:0.0:1789185594.795118:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898355072:12345-0@lo:400: Request processed in 27us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.795123:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789185594.795136:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185594.795141:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898354432:12345-0@lo:400: 00000100:00100000:0.0:1789185594.795166:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898354432:12345-0@lo:400: Request processed in 25us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.795171:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185594.795193:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789185594.795198:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898354944:12345-0@lo:400: 00000100:00100000:0.0:1789185594.795226:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898354944:12345-0@lo:400: Request processed in 29us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185594.795231:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789185594.795253:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185594.795255:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185594.795258:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185594.795260:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789185594.795280:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b4a80 x1876096898353664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185594.795290:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898353664:0@lo:400: 00010000:00080000:0.0:1789185594.795301:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3486d80 x1876096898354176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185594.795310:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898354176:0@lo:400: 00010000:00080000:0.0:1789185594.795319:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3485500 x1876096898354688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185594.795326:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898354688:0@lo:400: 00010000:00080000:0.0:1789185594.795335:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3487b80 x1876096898354304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185594.795343:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898354304:0@lo:400: 00010000:00080000:0.0:1789185594.795353:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3485880 x1876096898354816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185594.795360:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898354816:0@lo:400: 00000100:00100000:3.0:1789185594.797084:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898353536:12345-0@lo:400: Request processed in 51us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185594.797097:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00010000:00080000:3.0:1789185594.797732:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b5500 x1876096898353920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185594.797749:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898353920:0@lo:400: 00010000:00080000:3.0:1789185594.797834:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3485180 x1876096898354432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185594.797845:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898354432:0@lo:400: 00010000:00080000:3.0:1789185594.797859:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3487100 x1876096898354944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185594.797867:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789185594.797882:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898354944:0@lo:400: 00000100:00100000:3.0:1789185594.797891:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898353536:0@lo:400: 00000100:00100000:3.0:1789185594.797902:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898354048:0@lo:400: 00010000:00080000:3.0:1789185594.797934:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3486a00 x1876096898354560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185594.797943:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898354560:0@lo:400: 00010000:00080000:3.0:1789185594.797954:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3487800 x1876096898355072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185594.797978:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898355072:0@lo:400: 00000100:00100000:1.0:1789185594.798777:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898355456:0@lo:13: 00000100:00100000:1.0:1789185594.798839:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185594.798890:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898355456 00000100:00100000:1.0:1789185594.798896:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898355456 00000100:00100000:1.0:1789185594.798953:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185594.798961:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898355456:12345-0@lo:13: 00002000:00000024:1.0:1789185594.798982:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185594.799024:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898355456:12345-0@lo:13: Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185594.799030:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789185594.799064:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b2300 x1876096898355456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185594.799079:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898355456:0@lo:13: 00000020:00000004:1.0:1789185594.823652:0:10035:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789185594.824203:0:10035:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789185595.687110:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789185596.064634:0:10083:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185596.064652:0:10083:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1789185596.326118:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185596.326144:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898355584:0@lo:41: 00000100:00100000:2.0:1789185596.326214:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185596.326457:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898355584 00000100:00100000:3.0:1789185596.326466:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898355584 00000100:00100000:3.0:1789185596.326531:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789185596.326543:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898355584:12345-0@lo:41: 00000004:00000024:3.0:1789185596.326590:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789185596.326652:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898355584:12345-0@lo:41: Request processed in 111us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185596.326659:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789185596.326778:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898355584:0@lo:41: 00000100:00100000:2.0:1789185596.602633:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185596.603105:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879427712 00000100:00100000:3.0:1789185596.603121:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879427712 00000100:00100000:3.0:1789185596.603264:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 184 00000100:00100000:3.0:1789185596.603275:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2388:x1876096879427712:12345-192.168.204.48@tcp:250: 00010000:00080000:3.0:1789185596.603315:0:6505:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b7f24e88-33a8-40da-ba13-9f98e96cc9b7@192.168.204.48@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:3.0:1789185596.603354:0:6505:0:(genops.c:1384:class_connect()) connect: client b7f24e88-33a8-40da-ba13-9f98e96cc9b7, cookie 0xda5c730d5a72d54 00000100:00080000:3.0:1789185596.603541:0:6505:0:(import.c:65:import_set_state_nolock()) ffff98f1c3168800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185596.603638:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+5:2388:x1876096879427712:12345-192.168.204.48@tcp:250: Request processed in 363us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185596.603648:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 184 00000100:00100000:1.0:1789185596.633441:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185596.637522:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879427840 00000100:00100000:3.0:1789185596.637548:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879427840 00000100:00100000:3.0:1789185596.637633:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 185 00000100:00100000:3.0:1789185596.637646:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+5:6149:x1876096879427840:12345-192.168.204.48@tcp:101: 00010000:00010000:3.0:1789185596.637669:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185596.637710:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51c81 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185596.639079:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c81 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185596.639103:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c81 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185596.639116:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da800, rc 0) 00000100:00100000:2.0:1789185596.640110:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+6:6149:x1876096879427840:12345-192.168.204.48@tcp:101: Request processed in 2455us (6672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185596.640148:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 185 00000100:00100000:1.0:1789185596.656394:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185596.656847:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879427968 00000100:00100000:3.0:1789185596.656872:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879427968 00000100:00100000:0.0:1789185596.657246:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 186 00000100:00100000:0.0:1789185596.657271:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+6:6149:x1876096879427968:12345-192.168.204.48@tcp:501: 00000100:00100000:0.0:1789185596.657442:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+6:6149:x1876096879427968:12345-192.168.204.48@tcp:501: Request processed in 176us (1063us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185596.657451:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 186 00000100:00100000:1.0:1789185596.662130:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185596.662399:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879428096 00000100:00100000:2.0:1789185596.662414:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879428096 00000100:00100000:2.0:1789185596.662487:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 187 00000100:00100000:2.0:1789185596.662499:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+6:6149:x1876096879428096:12345-192.168.204.48@tcp:101: 00010000:00010000:2.0:1789185596.662524:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185596.662548:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51c88 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185596.662588:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c88 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185596.662602:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c88 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185596.662613:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf000, rc 0) 00000100:00100000:2.0:1789185596.662692:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+7:6149:x1876096879428096:12345-192.168.204.48@tcp:101: Request processed in 195us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185596.662700:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 187 00000100:00100000:1.0:1789185596.669550:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185596.669690:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879428224 00000100:00100000:2.0:1789185596.669705:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879428224 00000100:00100000:2.0:1789185596.669900:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 188 00000100:00100000:2.0:1789185596.669946:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+7:6149:x1876096879428224:12345-192.168.204.48@tcp:501: 00000100:00100000:2.0:1789185596.670182:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:6149:x1876096879428224:12345-192.168.204.48@tcp:501: Request processed in 239us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185596.670192:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 188 00000100:00100000:1.0:1789185596.675023:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185596.675091:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879428352 00000100:00100000:0.0:1789185596.675106:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879428352 00000100:00100000:0.0:1789185596.675177:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 189 00000100:00100000:0.0:1789185596.675190:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:6149:x1876096879428352:12345-192.168.204.48@tcp:503: 00000100:00100000:0.0:1789185596.677661:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:6149:x1876096879428352:12345-192.168.204.48@tcp:503: Request processed in 2456us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185596.677681:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 189 00000100:00100000:1.0:1789185596.690557:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185596.691175:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879428480 00000100:00100000:2.0:1789185596.691208:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879428480 00000100:00100000:2.0:1789185596.691285:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 190 00000100:00100000:2.0:1789185596.691298:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:6168:x1876096879428480:12345-192.168.204.48@tcp:502: 00000100:00100000:2.0:1789185596.691531:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:6168:x1876096879428480:12345-192.168.204.48@tcp:502: Request processed in 235us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185596.691540:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 190 00010000:00010000:0.0:1789185596.710152:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185596.750188:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185596.750309:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879428608 00000100:00100000:0.0:1789185596.750325:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879428608 00000100:00100000:3.0:1789185596.750478:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 191 00000100:00100000:3.0:1789185596.750493:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:6168:x1876096879428608:12345-192.168.204.48@tcp:502: 00000100:00100000:3.0:1789185596.751088:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:6168:x1876096879428608:12345-192.168.204.48@tcp:502: Request processed in 594us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185596.751099:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 191 00000100:00100000:1.0:1789185596.758199:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185596.773507:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879428736 00000100:00100000:2.0:1789185596.773530:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879428736 00000100:00100000:2.0:1789185596.773629:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 192 00000100:00100000:2.0:1789185596.773642:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:6149:x1876096879428736:12345-192.168.204.48@tcp:101: 00010000:00010000:2.0:1789185596.773666:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185596.773690:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51cb9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185596.776120:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cb9 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185596.776157:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cb9 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185596.776169:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf800, rc 0) 00000100:00100000:2.0:1789185596.776402:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6149:x1876096879428736:12345-192.168.204.48@tcp:101: Request processed in 2750us (18206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185596.776413:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 192 00000100:00100000:1.0:1789185596.792314:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185596.792538:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879428864 00000100:00100000:0.0:1789185596.792554:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879428864 00000100:00100000:0.0:1789185596.792633:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 193 00000100:00100000:0.0:1789185596.792646:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6149:x1876096879428864:12345-192.168.204.48@tcp:256: 20000000:01000000:0.0:1789185596.792683:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789185596.792733:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789185596.792739:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789185596.792743:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789185596.792746:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789185596.792749:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789185596.796436:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6149:x1876096879428864:12345-192.168.204.48@tcp:256: Request processed in 3774us (4118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185596.796456:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 193 00000100:00100000:1.0:1789185596.806025:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185596.806149:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879428992 00000100:00100000:3.0:1789185596.806167:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879428992 00000100:00100000:3.0:1789185596.806248:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 194 00000100:00100000:3.0:1789185596.806263:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6149:x1876096879428992:12345-192.168.204.48@tcp:101: 00010000:00010000:3.0:1789185596.806286:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185596.806315:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51cc0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185596.806358:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cc0 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185596.806370:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cc0 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185596.806380:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185596.806463:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6149:x1876096879428992:12345-192.168.204.48@tcp:101: Request processed in 203us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185596.806470:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 194 00000100:00100000:1.0:1789185596.816560:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185596.817885:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879429120 00000100:00100000:0.0:1789185596.817952:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879429120 00000100:00100000:0.0:1789185596.818046:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 195 00000100:00100000:0.0:1789185596.818058:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6149:x1876096879429120:12345-192.168.204.48@tcp:501: 00000100:00100000:0.0:1789185596.818280:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6149:x1876096879429120:12345-192.168.204.48@tcp:501: Request processed in 225us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185596.818289:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 195 00000100:00100000:1.0:1789185596.827686:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185596.828127:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879429248 00000100:00100000:2.0:1789185596.828144:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879429248 00000100:00100000:2.0:1789185596.828226:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 196 00000100:00100000:2.0:1789185596.828239:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6149:x1876096879429248:12345-192.168.204.48@tcp:503: 00000100:00100000:2.0:1789185596.828466:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6149:x1876096879429248:12345-192.168.204.48@tcp:503: Request processed in 228us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185596.828475:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 196 00000100:00100000:1.0:1789185596.831683:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185596.831879:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879429376 00000100:00100000:3.0:1789185596.831893:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879429376 00000100:00100000:3.0:1789185596.832014:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 197 00000100:00100000:3.0:1789185596.832027:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6173:x1876096879429376:12345-192.168.204.48@tcp:502: 00000100:00100000:3.0:1789185596.832253:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6173:x1876096879429376:12345-192.168.204.48@tcp:502: Request processed in 228us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185596.832262:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 197 00000100:00100000:1.0:1789185596.841374:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185596.841598:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879429504 00000100:00100000:0.0:1789185596.841614:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879429504 00000100:00100000:0.0:1789185596.841688:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 198 00000100:00100000:0.0:1789185596.841703:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6173:x1876096879429504:12345-192.168.204.48@tcp:502: 00000100:00100000:0.0:1789185596.842589:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6173:x1876096879429504:12345-192.168.204.48@tcp:502: Request processed in 881us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185596.842602:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 198 00000100:00100000:1.0:1789185596.851344:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185596.851404:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185596.851603:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879429632 00000100:00100000:3.0:1789185596.851619:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879429632 00000100:00100000:3.0:1789185596.851680:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879429888 00000100:00100000:3.0:1789185596.851684:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879429888 00000100:00100000:3.0:1789185596.851707:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:3.0:1789185596.851734:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2388:x1876096879429632:12345-192.168.204.48@tcp:38: 00010000:00080000:3.0:1789185596.851779:0:9473:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:3.0:1789185596.851855:0:9473:0:(genops.c:1384:class_connect()) connect: client f993ea83-7802-4340-a17e-bffdbb8158b1, cookie 0xda5c730d5a72d77 00000004:00100000:3.0:1789185596.851901:0:9473:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789185596.852256:0:9473:0:(import.c:65:import_set_state_nolock()) ffff98f1c3169000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185596.852342:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2388:x1876096879429632:12345-192.168.204.48@tcp:38: Request processed in 623us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185596.852351:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:3.0:1789185596.852376:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:3.0:1789185596.852394:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2388:x1876096879429888:12345-192.168.204.48@tcp:38: 00010000:00080000:3.0:1789185596.852415:0:9473:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:3.0:1789185596.852455:0:9473:0:(genops.c:1384:class_connect()) connect: client f993ea83-7802-4340-a17e-bffdbb8158b1, cookie 0xda5c730d5a72d7e 00000004:00100000:3.0:1789185596.852471:0:9473:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789185596.853526:0:9473:0:(import.c:65:import_set_state_nolock()) ffff98f1c310d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185596.853592:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2388:x1876096879429888:12345-192.168.204.48@tcp:38: Request processed in 1207us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185596.853603:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:3.0:1789185597.350264:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185597.350422:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185597.350454:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898355840:0@lo:13: 00000100:00100000:0.0:1789185597.350552:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185597.352118:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898355840 00000100:00100000:2.0:1789185597.352135:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898355840 00000100:00100000:2.0:1789185597.352241:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789185597.352257:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898355840:12345-0@lo:13: 00002000:00000024:2.0:1789185597.352302:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185597.352397:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898355840:12345-0@lo:13: Request processed in 145us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185597.352404:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789185597.352517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185597.352569:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b2680 x1876096898355840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185597.352618:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898355840:0@lo:13: 00000100:00100000:3.0:1789185597.360901:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898355712:0@lo:13: 00000100:00100000:3.0:1789185597.361048:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185597.361167:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898355712 00000100:00100000:0.0:1789185597.361180:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898355712 00000100:00100000:0.0:1789185597.361281:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789185597.361302:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898355712:12345-0@lo:13: 00002000:00000024:0.0:1789185597.361338:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185597.361402:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898355712:12345-0@lo:13: Request processed in 110us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185597.361410:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789185597.363172:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f270aa00 x1876096898355712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185597.363235:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f270aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898355712:0@lo:13: 00000100:00080000:2.0:1789185597.366670:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185597.734283:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185597.881627:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185597.881676:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185597.881738:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185597.881848:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879430144 00000100:00100000:0.0:1789185597.881864:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879430144 00000100:00100000:0.0:1789185597.881981:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879430016 00000100:00100000:0.0:1789185597.881985:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879430016 00000100:00100000:0.0:1789185597.882009:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879429760 00000100:00100000:0.0:1789185597.882012:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879429760 00000100:00100000:0.0:1789185597.882033:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:0.0:1789185597.882044:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:6149:x1876096879430144:12345-192.168.204.48@tcp:41: 00000004:00000024:0.0:1789185597.882091:0:8147:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789185597.882145:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:2.0:1789185597.882169:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:0:x1876096879430016:12345-192.168.204.48@tcp:41: 00000100:00100000:0.0:1789185597.882183:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:6149:x1876096879430144:12345-192.168.204.48@tcp:41: Request processed in 132us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185597.882208:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 9 00000004:00000024:2.0:1789185597.882228:0:6513:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185597.882240:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00100000:0.0:1789185597.882252:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:0:x1876096879429760:12345-192.168.204.48@tcp:41: 00000004:00000024:0.0:1789185597.882269:0:8147:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789185597.882309:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:0:x1876096879430016:12345-192.168.204.48@tcp:41: Request processed in 148us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185597.882312:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:0:x1876096879429760:12345-192.168.204.48@tcp:41: Request processed in 60us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185597.882322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:0.0:1789185597.882339:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00080000:1.0:1789185597.882996:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185597.883005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185597.892208:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185597.892665:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879430272 00000100:00100000:2.0:1789185597.892679:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879430272 00000100:00100000:2.0:1789185597.892837:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:2.0:1789185597.892954:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6149:x1876096879430272:12345-192.168.204.48@tcp:40: 00000100:00100000:2.0:1789185597.893084:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6149:x1876096879430272:12345-192.168.204.48@tcp:40: Request processed in 135us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185597.893094:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:1.0:1789185597.897196:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185597.897237:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185597.897337:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879430400 00000100:00100000:0.0:1789185597.897347:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879430400 00000100:00100000:0.0:1789185597.897395:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879430528 00000100:00100000:0.0:1789185597.897398:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879430528 00000100:00100000:0.0:1789185597.897427:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00100000:0.0:1789185597.897435:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2388:x1876096879430400:12345-192.168.204.48@tcp:8: 00010000:00080000:0.0:1789185597.897468:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:0.0:1789185597.897502:0:8427:0:(genops.c:1384:class_connect()) connect: client f993ea83-7802-4340-a17e-bffdbb8158b1, cookie 0xda5c730d5a72d85 00002000:00100000:0.0:1789185597.897514:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f993ea83-7802-4340-a17e-bffdbb8158b1/ffff98f1c310f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789185597.897527:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789185597.897775:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789185597.897805:0:8427:0:(import.c:65:import_set_state_nolock()) ffff98f1c310e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185597.897867:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2388:x1876096879430400:12345-192.168.204.48@tcp:8: Request processed in 430us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185597.897875:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00100000:0.0:1789185597.897936:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:0.0:1789185597.897942:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2388:x1876096879430528:12345-192.168.204.48@tcp:8: 00010000:00080000:0.0:1789185597.897959:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:0.0:1789185597.897979:0:8427:0:(genops.c:1384:class_connect()) connect: client f993ea83-7802-4340-a17e-bffdbb8158b1, cookie 0xda5c730d5a72d8c 00002000:00100000:0.0:1789185597.897984:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f993ea83-7802-4340-a17e-bffdbb8158b1/ffff98f2ff970800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789185597.898001:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789185597.898120:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789185597.898135:0:8427:0:(import.c:65:import_set_state_nolock()) ffff98f2ff972800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185597.898178:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2388:x1876096879430528:12345-192.168.204.48@tcp:8: Request processed in 234us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185597.898184:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:1.0:1789185597.900351:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185597.900403:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185597.900493:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879430784 00000100:00100000:2.0:1789185597.900549:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879430784 00000100:00100000:2.0:1789185597.900642:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 199 00000100:00100000:2.0:1789185597.900655:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879430784:12345-192.168.204.48@tcp:400: 00000100:00100000:2.0:1789185597.900781:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879430784:12345-192.168.204.48@tcp:400: Request processed in 127us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185597.900790:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 199 00000100:00100000:0.0:1789185597.901206:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879430656 00000100:00100000:0.0:1789185597.901218:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879430656 00000100:00100000:0.0:1789185597.901289:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:0.0:1789185597.901300:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6149:x1876096879430656:12345-192.168.204.48@tcp:900: 00000100:00100000:0.0:1789185597.901899:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6149:x1876096879430656:12345-192.168.204.48@tcp:900: Request processed in 597us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185597.901929:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:1.0:1789185597.913074:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185597.913209:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879430912 00000100:00100000:3.0:1789185597.913219:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879430912 00000100:00100000:3.0:1789185597.913281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:3.0:1789185597.913294:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6149:x1876096879430912:12345-192.168.204.48@tcp:33: 00000004:00080000:3.0:1789185597.969448:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 56067us 00000004:00200000:0.0:1789185598.006068:0:6515:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789185598.006965:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6149:x1876096879430912:12345-192.168.204.48@tcp:33: Request processed in 93664us (93892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185598.006983:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:1.0:1789185598.273753:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185598.273869:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879431040 00000100:00100000:0.0:1789185598.273880:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879431040 00000100:00100000:0.0:1789185598.273992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:0.0:1789185598.274005:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6191:x1876096879431040:12345-192.168.204.48@tcp:101: 00010000:00010000:0.0:1789185598.274031:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185598.274113:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51cf1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185598.274191:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a72d9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185598.274206:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a72d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185598.274242:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a72d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185598.274292:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789185598.274297:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185598.274313:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a72d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185598.274341:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cf1 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185598.274362:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a72d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cf1 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185598.274371:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2100) 00010000:00010000:0.0:1789185598.274375:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185598.274378:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0030400, rc 0) 00000100:00100000:0.0:1789185598.274444:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:6191:x1876096879431040:12345-192.168.204.48@tcp:101: Request processed in 443us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185598.274452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 13 00010000:00010000:0.0:1789185598.758476:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185599.783653:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185599.910358:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898356096:0@lo:400: 00000100:00100000:0.0:1789185599.910429:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185599.910484:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898356608:0@lo:400: 00000100:00100000:0.0:1789185599.910503:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185599.910527:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898357120:0@lo:400: 00000100:00100000:0.0:1789185599.910545:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185599.910592:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789185599.910598:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898355968:0@lo:400: 00000100:00100000:0.0:1789185599.910627:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185599.910652:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898356480:0@lo:400: 00000100:00100000:0.0:1789185599.910706:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185599.910841:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898356352:0@lo:400: 00000100:00100000:1.0:1789185599.911023:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898356096 00000100:00100000:1.0:1789185599.911039:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898356096 00000100:00100000:1.0:1789185599.911084:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898356608 00000100:00100000:1.0:1789185599.911087:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898356608 00000100:00100000:1.0:1789185599.911110:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898357120 00000100:00100000:1.0:1789185599.911113:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898357120 00000100:00100000:1.0:1789185599.911129:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185599.911138:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898356096:12345-0@lo:400: 00000100:00100000:2.0:1789185599.911274:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789185599.911283:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898356608:12345-0@lo:400: 00000100:00100000:3.0:1789185599.916146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185599.916194:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898356864:0@lo:400: 00000100:00100000:3.0:1789185599.916240:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185599.916283:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898357376:0@lo:400: 00000100:00100000:3.0:1789185599.916304:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185599.916346:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898357888:0@lo:41: 00000100:00100000:3.0:1789185599.916370:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185599.916392:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789185599.916398:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898356224:0@lo:400: 00000100:00100000:3.0:1789185599.916419:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185599.916437:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898356736:0@lo:400: 00000100:00100000:3.0:1789185599.916458:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185599.916470:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898357248:0@lo:400: 00000100:00100000:3.0:1789185599.916509:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185599.916521:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898357760:0@lo:13: 00000100:00100000:3.0:1789185599.916543:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185599.916644:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898356864 00000100:00100000:0.0:1789185599.916654:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898356864 00000100:00100000:3.0:1789185599.916783:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898356352 00000100:00100000:3.0:1789185599.916787:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898356352 00000100:00100000:3.0:1789185599.916811:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898356736 00000100:00100000:3.0:1789185599.916813:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898356736 00000100:00100000:3.0:1789185599.916825:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898357248 00000100:00100000:3.0:1789185599.916828:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898357248 00000100:00100000:3.0:1789185599.916845:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185599.916853:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898357120:12345-0@lo:400: 00000100:00100000:3.0:1789185599.916927:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898357120:12345-0@lo:400: Request processed in 54us (6361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.916934:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185599.916951:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789185599.916956:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898356352:12345-0@lo:400: 00000100:00100000:3.0:1789185599.917008:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898356352:12345-0@lo:400: Request processed in 52us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.917014:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789185599.917027:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789185599.917033:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898356736:12345-0@lo:400: 00000100:00100000:3.0:1789185599.917059:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898356736:12345-0@lo:400: Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.917065:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789185599.917076:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789185599.917082:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898357248:12345-0@lo:400: 00000100:00100000:3.0:1789185599.917108:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898357248:12345-0@lo:400: Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.917121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789185599.917180:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898357376 00000100:00100000:0.0:1789185599.917184:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898357376 00000100:00100000:3.0:1789185599.922919:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185599.922948:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898356864:12345-0@lo:400: 00000100:00100000:3.0:1789185599.923055:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898356864:12345-0@lo:400: Request processed in 123us (6813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.923063:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185599.923092:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185599.923100:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898357376:12345-0@lo:400: 00000100:00100000:3.0:1789185599.923134:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898357376:12345-0@lo:400: Request processed in 36us (6829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.923140:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185599.923188:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898356480 00000100:00100000:3.0:1789185599.923197:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898356480 00000100:00100000:3.0:1789185599.923228:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898357888 00000100:00100000:3.0:1789185599.923231:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898357888 00000100:00100000:3.0:1789185599.923243:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898356224 00000100:00100000:3.0:1789185599.923246:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898356224 00000100:00100000:3.0:1789185599.923257:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789185599.923263:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898356480:12345-0@lo:400: 00000100:00100000:3.0:1789185599.923298:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898356480:12345-0@lo:400: Request processed in 36us (12592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.923305:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789185599.923318:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789185599.923324:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898357888:12345-0@lo:41: 00000004:00000024:3.0:1789185599.923350:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789185599.923382:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898357888:12345-0@lo:41: Request processed in 58us (7010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.923403:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789185599.923416:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789185599.923421:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898356224:12345-0@lo:400: 00000100:00100000:3.0:1789185599.923452:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898356224:12345-0@lo:400: Request processed in 31us (7032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.923458:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789185599.923484:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898357760 00000100:00100000:3.0:1789185599.923488:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898357760 00000100:00100000:3.0:1789185599.923525:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185599.923532:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898357760:12345-0@lo:13: 00002000:00000024:3.0:1789185599.923553:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185599.923586:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898357760:12345-0@lo:13: Request processed in 54us (7041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.923592:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185599.923617:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185599.923636:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898357632:0@lo:13: 00000100:00100000:3.0:1789185599.923688:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185599.925369:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898355968 00000100:00100000:0.0:1789185599.925384:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898355968 00000100:00100000:0.0:1789185599.925448:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789185599.925457:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898355968:12345-0@lo:400: 00000100:00100000:0.0:1789185599.925558:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898355968:12345-0@lo:400: Request processed in 102us (14930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185599.925566:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789185599.925634:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898356480:0@lo:400: 00000100:00100000:0.0:1789185599.925645:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898356992:0@lo:400: 00000100:00100000:0.0:1789185599.925688:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185599.925713:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898357504:0@lo:400: 00000100:00100000:3.0:1789185599.926601:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898357632 00000100:00100000:3.0:1789185599.926611:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898357632 00000100:00100000:3.0:1789185599.926676:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185599.926685:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898357632:12345-0@lo:13: 00002000:00000024:3.0:1789185599.926704:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185599.926771:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898357632:12345-0@lo:13: Request processed in 87us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.926778:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185599.926803:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898356992 00000100:00100000:3.0:1789185599.926818:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898356992 00000100:00100000:3.0:1789185599.926851:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789185599.926858:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898356992:12345-0@lo:400: 00000100:00100000:3.0:1789185599.926896:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898356992:12345-0@lo:400: Request processed in 39us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.926902:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185599.926946:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898356096:12345-0@lo:400: Request processed in 15807us (16514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.926952:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898356224:0@lo:400: 00000100:00100000:1.0:1789185599.926955:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789185599.926967:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3487100 x1876096898356736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185599.926978:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898356736:0@lo:400: 00000100:00080000:1.0:1789185599.926986:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789185599.926989:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3485500 x1876096898357248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789185599.926991:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185599.926994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185599.926996:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185599.926997:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898357248:0@lo:400: 00010000:00080000:3.0:1789185599.927007:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758fb80 x1876096898357760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185599.927020:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898357760:0@lo:13: 00000100:00100000:3.0:1789185599.927032:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898357888:0@lo:41: 00000100:00100000:3.0:1789185599.927045:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898356352:0@lo:400: 00010000:00080000:3.0:1789185599.927055:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3485180 x1876096898356864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185599.927062:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898356864:0@lo:400: 00010000:00080000:3.0:1789185599.927072:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3486d80 x1876096898357376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185599.927094:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898357376:0@lo:400: 00010000:00080000:3.0:1789185599.927139:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758ea00 x1876096898357632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185599.927151:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898357632:0@lo:13: 00000100:00100000:2.0:1789185599.927863:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898356608:12345-0@lo:400: Request processed in 16577us (17353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185599.927873:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789185599.928357:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185599.928408:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898356096:0@lo:400: 00000100:00100000:0.0:1789185599.928420:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898356608:0@lo:400: 00000100:00100000:0.0:1789185599.928430:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898357120:0@lo:400: 00000100:00100000:0.0:1789185599.928455:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898355968:0@lo:400: 00010000:00080000:0.0:1789185599.928483:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3485880 x1876096898356992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185599.928492:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898356992:0@lo:400: 00000100:00100000:3.0:1789185599.928874:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898357504 00000100:00100000:3.0:1789185599.928881:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898357504 00000100:00100000:3.0:1789185599.928987:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185599.928998:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898357504:12345-0@lo:400: 00000100:00100000:3.0:1789185599.929066:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898357504:12345-0@lo:400: Request processed in 70us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185599.929072:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789185599.929191:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b4000 x1876096898357504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185599.929202:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898357504:0@lo:400: 00000100:00100000:2.0:1789185600.548022:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185600.548155:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879431168 00000100:00100000:3.0:1789185600.548166:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879431168 00000100:00100000:3.0:1789185600.548254:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:3.0:1789185600.548266:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:6244:x1876096879431168:12345-192.168.204.48@tcp:41: 00000004:00000024:3.0:1789185600.548301:0:6512:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789185600.548379:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:6244:x1876096879431168:12345-192.168.204.48@tcp:41: Request processed in 116us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185600.548388:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00080000:1.0:1789185600.548527:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185600.554165:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185600.556377:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879431296 00000100:00100000:0.0:1789185600.556395:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879431296 00000100:00100000:0.0:1789185600.556496:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:0.0:1789185600.556507:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6244:x1876096879431296:12345-192.168.204.48@tcp:41: 00000004:00000024:0.0:1789185600.556547:0:8147:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185600.556632:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6244:x1876096879431296:12345-192.168.204.48@tcp:41: Request processed in 127us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185600.556640:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00080000:1.0:1789185600.556885:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185600.562675:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185600.562939:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879431424 00000100:00100000:3.0:1789185600.562955:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879431424 00000100:00100000:3.0:1789185600.563080:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:3.0:1789185600.563096:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6244:x1876096879431424:12345-192.168.204.48@tcp:13: 00002000:00000024:3.0:1789185600.563160:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185600.563280:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6244:x1876096879431424:12345-192.168.204.48@tcp:13: Request processed in 189us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185600.563316:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00080000:1.0:1789185600.563436:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185600.571205:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185600.574879:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879431552 00000100:00100000:0.0:1789185600.574959:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879431552 00000100:00100000:0.0:1789185600.575072:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:0.0:1789185600.575086:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6244:x1876096879431552:12345-192.168.204.48@tcp:13: 00002000:00000024:0.0:1789185600.575121:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185600.575229:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f993ea83-7802-4340-a17e-bffdbb8158b1+6:6244:x1876096879431552:12345-192.168.204.48@tcp:13: Request processed in 146us (4038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185600.575237:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00080000:1.0:1789185600.576172:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789185600.806167:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185601.453901:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185601.453962:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898358016:0@lo:41: 00000100:00100000:3.0:1789185601.454058:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185601.454147:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898358016 00000100:00100000:3.0:1789185601.454157:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898358016 00000100:00100000:3.0:1789185601.454222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789185601.454232:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898358016:12345-0@lo:41: 00000004:00000024:3.0:1789185601.454283:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789185601.454343:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898358016:12345-0@lo:41: Request processed in 112us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185601.454351:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789185601.454409:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898358016:0@lo:41: 00010000:00010000:0.0:1789185601.831132:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789185601.968936:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000100:00100000:2.0:1789185602.471152:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898358272:0@lo:13: 00000100:00100000:2.0:1789185602.471252:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185602.471605:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898358144:0@lo:13: 00000100:00100000:3.0:1789185602.471662:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185602.471778:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898358272 00000100:00100000:1.0:1789185602.471789:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898358272 00000100:00100000:1.0:1789185602.471864:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898358144 00000100:00100000:1.0:1789185602.471868:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898358144 00000100:00100000:1.0:1789185602.471891:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789185602.471901:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898358272:12345-0@lo:13: 00002000:00000024:1.0:1789185602.471976:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185602.472078:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898358272:12345-0@lo:13: Request processed in 177us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185602.472087:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789185602.472107:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789185602.472115:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898358144:12345-0@lo:13: 00002000:00000024:1.0:1789185602.472127:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185602.472155:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898358144:12345-0@lo:13: Request processed in 40us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185602.472161:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789185602.472204:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758e680 x1876096898358272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185602.472228:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898358272:0@lo:13: 00000100:00080000:3.0:1789185602.472579:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789185602.472621:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7495500 x1876096898358144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185602.472639:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898358144:0@lo:13: 00010000:00010000:0.0:1789185602.854701:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185602.920814:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185602.920862:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185602.920932:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185602.920960:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185602.920988:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185602.921026:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879431680 00000100:00100000:1.0:1789185602.921041:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879431680 00000100:00100000:1.0:1789185602.921116:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 201 00000100:00100000:1.0:1789185602.921127:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2392:x1876096879431680:12345-192.168.204.48@tcp:400: 00000100:00100000:1.0:1789185602.921233:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2392:x1876096879431680:12345-192.168.204.48@tcp:400: Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185602.921242:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 201 00000100:00100000:1.0:1789185602.921284:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879431808 00000100:00100000:1.0:1789185602.921288:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879431808 00000100:00100000:1.0:1789185602.921365:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879431936 00000100:00100000:1.0:1789185602.921369:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879431936 00000100:00100000:1.0:1789185602.921395:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:1.0:1789185602.921402:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879431808:12345-192.168.204.48@tcp:400: 00000100:00100000:1.0:1789185602.921437:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879431808:12345-192.168.204.48@tcp:400: Request processed in 36us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185602.921443:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:1.0:1789185602.921455:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:1.0:1789185602.921462:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879431936:12345-192.168.204.48@tcp:400: 00000100:00100000:1.0:1789185602.921486:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879431936:12345-192.168.204.48@tcp:400: Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185602.921492:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:1.0:1789185602.921513:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879432064 00000100:00100000:1.0:1789185602.921517:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879432064 00000100:00100000:1.0:1789185602.921549:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879432192 00000100:00100000:1.0:1789185602.921552:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879432192 00000100:00100000:1.0:1789185602.921574:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:1.0:1789185602.921581:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879432064:12345-192.168.204.48@tcp:400: 00000100:00100000:1.0:1789185602.921621:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879432064:12345-192.168.204.48@tcp:400: Request processed in 40us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185602.921627:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:1.0:1789185602.921640:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:1.0:1789185602.921646:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879432192:12345-192.168.204.48@tcp:400: 00000100:00100000:1.0:1789185602.921675:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879432192:12345-192.168.204.48@tcp:400: Request processed in 29us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185602.921680:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00080000:1.0:1789185602.921867:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185602.921873:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185602.921876:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185602.921879:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789185602.991122:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000001:00100000:3.0:1789185602.994793:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000001:02000400:3.0:1789185603.473420:0:10183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789185603.880335:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789185604.010345:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00010000:00010000:2.0:1789185604.902146:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185605.030351:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185605.030383:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898358400:0@lo:13: 00000100:00100000:1.0:1789185605.030468:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185605.031217:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898358528:0@lo:13: 00000100:00100000:1.0:1789185605.031251:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185605.031282:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185605.031289:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898358656:0@lo:41: 00000100:00100000:1.0:1789185605.031314:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185605.031348:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898358400 00000100:00100000:1.0:1789185605.031355:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898358400 00000100:00100000:1.0:1789185605.031406:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898358528 00000100:00100000:1.0:1789185605.031409:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898358528 00000100:00100000:1.0:1789185605.031426:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185605.031433:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898358400:12345-0@lo:13: 00002000:00000024:1.0:1789185605.031459:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185605.032237:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789185605.032250:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898358528:12345-0@lo:13: 00002000:00000024:2.0:1789185605.032265:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185605.032319:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898358528:12345-0@lo:13: Request processed in 73us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185605.032326:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789185605.032438:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898358784:0@lo:400: 00000100:00100000:2.0:1789185605.032473:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185605.032602:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898359296:0@lo:400: 00000100:00100000:2.0:1789185605.032630:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185605.032648:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898359808:0@lo:400: 00000100:00100000:2.0:1789185605.032667:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185605.032688:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789185605.032694:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898358912:0@lo:400: 00000100:00100000:2.0:1789185605.032714:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185605.032730:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898359424:0@lo:400: 00000100:00100000:2.0:1789185605.032748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185605.032763:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898359936:0@lo:400: 00000100:00100000:2.0:1789185605.032785:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185605.032809:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898359296 00000100:00100000:2.0:1789185605.032815:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898359296 00000100:00100000:2.0:1789185605.032843:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898359808 00000100:00100000:2.0:1789185605.032846:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898359808 00000100:00100000:2.0:1789185605.032859:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898358912 00000100:00100000:2.0:1789185605.032862:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898358912 00000100:00100000:2.0:1789185605.032871:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898359424 00000100:00100000:2.0:1789185605.032874:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898359424 00000100:00100000:2.0:1789185605.032886:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898359936 00000100:00100000:2.0:1789185605.032888:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898359936 00000100:00100000:2.0:1789185605.032902:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789185605.032933:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898359296:12345-0@lo:400: 00000100:00100000:2.0:1789185605.032972:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898359296:12345-0@lo:400: Request processed in 64us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185605.032978:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789185605.032995:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789185605.033000:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898359808:12345-0@lo:400: 00000100:00100000:2.0:1789185605.033036:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898359808:12345-0@lo:400: Request processed in 35us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185605.033042:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789185605.033164:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898359168:0@lo:400: 00000100:00100000:3.0:1789185605.033199:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185605.033230:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898359680:0@lo:400: 00000100:00100000:3.0:1789185605.033255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185605.033275:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789185605.033282:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898359040:0@lo:400: 00000100:00100000:3.0:1789185605.033303:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185605.033312:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898359552:0@lo:400: 00000100:00100000:3.0:1789185605.033330:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185605.033357:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898358656 00000100:00100000:3.0:1789185605.033362:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898358656 00000100:00100000:3.0:1789185605.033386:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898359168 00000100:00100000:3.0:1789185605.033388:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898359168 00000100:00100000:3.0:1789185605.033402:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789185605.033408:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898358656:12345-0@lo:41: 00000004:00000024:3.0:1789185605.033436:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789185605.033470:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898358656:12345-0@lo:41: Request processed in 62us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185605.033477:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789185605.033504:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789185605.033511:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898359168:12345-0@lo:400: 00000100:00100000:3.0:1789185605.033544:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898359168:12345-0@lo:400: Request processed in 34us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185605.033550:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789185605.033581:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898359680 00000100:00100000:3.0:1789185605.033585:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898359680 00000100:00100000:3.0:1789185605.033612:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898359552 00000100:00100000:3.0:1789185605.033615:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898359552 00000100:00100000:3.0:1789185605.033634:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185605.033640:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898359680:12345-0@lo:400: 00000100:00100000:3.0:1789185605.033680:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898359680:12345-0@lo:400: Request processed in 40us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185605.033687:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185605.033697:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185605.033703:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898359552:12345-0@lo:400: 00000100:00100000:3.0:1789185605.033728:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898359552:12345-0@lo:400: Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185605.033734:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185605.033793:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898358656:0@lo:41: 00010000:00080000:3.0:1789185605.033809:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758d180 x1876096898358528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185605.033823:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898358528:0@lo:13: 00010000:00080000:3.0:1789185605.033854:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7495f80 x1876096898359552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185605.033863:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898359552:0@lo:400: 00000100:00100000:3.0:1789185605.033872:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898359168:0@lo:400: 00010000:00080000:3.0:1789185605.033880:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7494380 x1876096898359680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185605.033888:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898359680:0@lo:400: 00000100:00100000:1.0:1789185605.033985:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898358400:12345-0@lo:13: Request processed in 2550us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185605.033993:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789185605.034020:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185605.034024:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185605.034026:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185605.034028:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185605.034039:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898358784 00000100:00100000:1.0:1789185605.034043:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898358784 00000100:00100000:1.0:1789185605.034586:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789185605.034595:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898358784:12345-0@lo:400: 00000100:00100000:1.0:1789185605.034649:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898358784:12345-0@lo:400: Request processed in 56us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185605.034656:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789185605.038541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898359040 00000100:00100000:1.0:1789185605.038559:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898359040 00000100:00100000:1.0:1789185605.038621:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789185605.038631:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898358912:12345-0@lo:400: 00000100:00100000:1.0:1789185605.038727:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898358912:12345-0@lo:400: Request processed in 97us (6011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185605.038735:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789185605.038754:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789185605.038762:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898359424:12345-0@lo:400: 00000100:00100000:1.0:1789185605.038792:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898359424:12345-0@lo:400: Request processed in 32us (6044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185605.038798:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789185605.038810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185605.038816:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898359936:12345-0@lo:400: 00000100:00100000:1.0:1789185605.038842:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898359936:12345-0@lo:400: Request processed in 27us (6056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185605.038849:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185605.038860:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789185605.038866:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898359040:12345-0@lo:400: 00000100:00100000:1.0:1789185605.038902:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898359040:12345-0@lo:400: Request processed in 36us (5597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185605.038925:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789185605.039135:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898358912:0@lo:400: 00010000:00080000:2.0:1789185605.039150:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7495c00 x1876096898359424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185605.039162:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898359424:0@lo:400: 00010000:00080000:2.0:1789185605.039173:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7494e00 x1876096898359936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185605.039180:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898359936:0@lo:400: 00000100:00100000:2.0:1789185605.039190:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898358784:0@lo:400: 00000100:00100000:2.0:1789185605.039201:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898359296:0@lo:400: 00000100:00100000:2.0:1789185605.039212:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898359808:0@lo:400: 00010000:00080000:2.0:1789185605.039225:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758ed80 x1876096898358400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185605.039243:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898358400:0@lo:13: 00000100:00100000:3.0:1789185605.039425:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898359040:0@lo:400: 00010000:00010000:0.0:1789185605.926813:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185606.566581:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898360064:0@lo:41: 00000100:00100000:1.0:1789185606.566656:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185606.566941:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898360064 00000100:00100000:0.0:1789185606.566949:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898360064 00000100:00100000:0.0:1789185606.567008:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789185606.567016:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898360064:12345-0@lo:41: 00000004:00000024:0.0:1789185606.567048:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185606.581165:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898360064:12345-0@lo:41: Request processed in 14129us (14488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185606.581180:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789185606.582110:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898360064:0@lo:41: 00010000:00010000:2.0:1789185606.950816:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789185607.048717:0:10330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe43779c0 20000000:00000080:2.0:1789185607.048735:0:10330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f2f75b2000 uarg=0000000000000000 20000000:01000000:2.0:1789185607.048793:0:10330:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789185607.048796:0:10330:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789185607.048799:0:10330:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789185607.048804:0:10330:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789185607.048816:0:10330:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789185607.049127:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789185607.049130:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789185607.050105:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1789185607.050377:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1789185607.050422:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1789185607.050441:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1789185607.050455:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789185607.050457:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789185607.050899:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1789185607.052584:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1789185607.052629:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1789185607.052649:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1789185607.052665:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789185607.052668:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789185607.066093:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1789185607.066643:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1789185607.066673:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1789185607.066688:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1789185607.066712:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789185607.066732:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789185607.067688:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1789185607.067867:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1789185607.067891:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1789185607.067947:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1789185607.067964:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789185607.067974:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789185607.069942:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1789185607.070792:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1789185607.070821:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1789185607.070833:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:0.0:1789185607.070847:0:10330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789185607.070865:0:10330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070883:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c35 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070899:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c5f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070942:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c9e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070950:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72cac expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070955:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72cba expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070962:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72cd6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070974:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72d00 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070980:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72d1c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070986:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72d3f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.070996:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c81 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071002:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c88 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071018:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071054:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c88 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071068:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c88 expref: 9 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.071083:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360192:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185607.071314:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c81 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071323:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c81 expref: 9 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.071332:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360320:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185607.071558:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72d3f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071567:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72d3f expref: 23 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.071586:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360448:0@lo:104: 00000100:00100000:0.0:1789185607.071628:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185607.071662:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72d1c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071681:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72d1c expref: 23 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.071689:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360576:0@lo:104: 00000100:00100000:0.0:1789185607.071709:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185607.071730:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72d00 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071736:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72d00 expref: 23 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.071742:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360704:0@lo:104: 00000100:00100000:0.0:1789185607.071758:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185607.071772:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72cd6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071779:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72cd6 expref: 23 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.071786:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360832:0@lo:104: 00000100:00100000:0.0:1789185607.071804:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185607.071816:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72cba expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071823:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72cba expref: 23 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.071829:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360960:0@lo:104: 00010000:00010000:0.0:1789185607.071857:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72cac expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071864:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72cac expref: 23 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.071871:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898361088:0@lo:104: 00010000:00010000:0.0:1789185607.071887:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72c9e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.071894:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72c9e expref: 23 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.071900:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898361216:0@lo:104: 00000100:00100000:3.0:1789185607.072432:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789185607.072453:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185607.072466:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185607.072474:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898360448 00000100:00100000:3.0:1789185607.072480:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898360448 00000100:00100000:3.0:1789185607.072515:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898360576 00000100:00100000:3.0:1789185607.072518:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898360576 00000100:00100000:3.0:1789185607.072540:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898360704 00000100:00100000:3.0:1789185607.072544:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898360704 00000100:00100000:3.0:1789185607.072552:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898360832 00000100:00100000:3.0:1789185607.072554:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898360832 00000100:00100000:3.0:1789185607.072562:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898360960 00000100:00100000:3.0:1789185607.072564:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898360960 00000100:00100000:3.0:1789185607.072572:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898361088 00000100:00100000:3.0:1789185607.072574:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898361088 00000100:00100000:3.0:1789185607.072586:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789185607.072594:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+8:10330:x1876096898360448:12345-0@lo:104: 00010000:00010000:3.0:1789185607.072607:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.072662:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185607.072667:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+8:10330:x1876096898360448:12345-0@lo:104: Request processed in 75us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.072673:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789185607.072691:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185607.072697:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+7:10330:x1876096898360576:12345-0@lo:104: 00010000:00010000:3.0:1789185607.072705:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.072749:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789185607.072754:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+7:10330:x1876096898360576:12345-0@lo:104: Request processed in 58us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.072760:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185607.072773:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185607.072779:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+6:10330:x1876096898360704:12345-0@lo:104: 00010000:00010000:3.0:1789185607.072787:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.072818:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789185607.072822:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+6:10330:x1876096898360704:12345-0@lo:104: Request processed in 45us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.072827:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185607.072839:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185607.072846:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f75b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+5:10330:x1876096898360832:12345-0@lo:104: 00010000:00010000:3.0:1789185607.072853:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.072884:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789185607.072889:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f75b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+5:10330:x1876096898360832:12345-0@lo:104: Request processed in 45us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.072893:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185607.072952:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789185607.072958:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:10330:x1876096898360960:12345-0@lo:104: 00010000:00010000:3.0:1789185607.072964:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073006:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789185607.073011:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+4:10330:x1876096898360960:12345-0@lo:104: Request processed in 54us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.073017:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789185607.073028:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185607.073034:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:10330:x1876096898361088:12345-0@lo:104: 00010000:00010000:3.0:1789185607.073041:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073064:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789185607.073068:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:10330:x1876096898361088:12345-0@lo:104: Request processed in 35us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.073073:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789185607.073094:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789185607.073100:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073106:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185607.073110:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073118:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185607.073125:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185607.073131:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185607.073172:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073178:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185607.073197:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073204:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300dde200/0xda5c730d5a72d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72d46 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073217:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789185607.073220:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073225:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde600 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185607.073228:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073234:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185607.073239:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185607.073244:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185607.073255:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073261:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185607.073622:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073641:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300dde600/0xda5c730d5a72d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72d23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073651:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789185607.073654:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073659:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185607.073662:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073668:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185607.073674:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185607.073679:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185607.073693:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073698:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185607.073703:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073709:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a72d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72d07 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073718:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789185607.073728:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073734:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166da00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185607.073737:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073744:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185607.073750:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185607.073755:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185607.073769:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073775:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185607.073781:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073788:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72cdd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073798:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185607.073801:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073806:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185607.073809:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073824:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185607.073830:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185607.073835:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185607.073847:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073853:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185607.073858:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073863:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30da000/0xda5c730d5a72cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72cc1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073871:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185607.073874:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073879:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185607.073882:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073887:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185607.073893:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185607.073902:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185607.073937:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073944:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185607.073948:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073954:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166c000/0xda5c730d5a72cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72cb3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.073977:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185607.073979:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185607.073981:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185607.073990:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185607.073996:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185607.074000:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185607.074014:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898361344:0@lo:103: 00000100:00100000:3.0:1789185607.074058:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185607.074082:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898361856:0@lo:103: 00000100:00100000:3.0:1789185607.074100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185607.074120:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185607.074126:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898361728:0@lo:103: 00000100:00100000:3.0:1789185607.074145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185607.074173:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898361600:0@lo:103: 00000100:00100000:3.0:1789185607.074194:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185607.074205:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789185607.074218:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898361472:0@lo:103: 00000100:00100000:3.0:1789185607.074239:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185607.074248:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898361984:0@lo:103: 00000100:00100000:0.0:1789185607.074542:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185607.074579:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72c5f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.074591:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72c5f expref: 23 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.074603:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898362112:0@lo:104: 00000100:00100000:0.0:1789185607.074625:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185607.074657:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72c35 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.074665:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72c35 expref: 23 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.074674:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898362240:0@lo:104: 00000100:00100000:0.0:1789185607.074702:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185607.074713:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185607.074733:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360448:0@lo:104: 00000100:00100000:0.0:1789185607.074741:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360576:0@lo:104: 00000100:00100000:0.0:1789185607.074749:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360704:0@lo:104: 00000100:00100000:0.0:1789185607.074756:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360832:0@lo:104: 00000100:00100000:0.0:1789185607.074763:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360960:0@lo:104: 00000100:00100000:0.0:1789185607.074771:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898361088:0@lo:104: 00000100:00100000:0.0:1789185607.075378:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898361344 00000100:00100000:0.0:1789185607.075387:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898361344 00010000:00010000:0.0:1789185607.075418:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72d3f expref: 24 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.075438:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898361856 00000100:00100000:0.0:1789185607.075441:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898361856 00010000:00010000:0.0:1789185607.075451:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72cba expref: 25 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.075460:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898361728 00000100:00100000:0.0:1789185607.075462:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898361728 00010000:00010000:0.0:1789185607.075471:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72cd6 expref: 26 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.075480:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898361600 00000100:00100000:0.0:1789185607.075482:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898361600 00010000:00010000:0.0:1789185607.075491:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72d00 expref: 27 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.075498:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898361472 00000100:00100000:0.0:1789185607.075501:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898361472 00010000:00010000:0.0:1789185607.075520:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72d1c expref: 28 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.075547:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185607.075554:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+28:3638:x1876096898361344:12345-0@lo:103: 00010000:00010000:0.0:1789185607.075567:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185607.075572:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72d3f expref: 28 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075582:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72d3f expref: 28 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075597:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30db600/0xda5c730d5a72d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72d3f expref: 28 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075612:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185607.075656:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+27:3638:x1876096898361344:12345-0@lo:103: Request processed in 102us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.075664:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185607.075705:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789185607.075711:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+26:3638:x1876096898361856:12345-0@lo:103: 00010000:00010000:0.0:1789185607.075719:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185607.075722:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72cba expref: 26 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075729:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72cba expref: 26 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075738:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72cba expref: 26 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075756:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185607.075775:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+25:3638:x1876096898361856:12345-0@lo:103: Request processed in 65us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.075780:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789185607.075793:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789185607.075798:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898361728:12345-0@lo:103: 00010000:00010000:0.0:1789185607.075804:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185607.075807:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72cd6 expref: 24 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075814:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72cd6 expref: 24 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075822:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72cdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72cd6 expref: 24 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075830:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185607.075846:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3638:x1876096898361728:12345-0@lo:103: Request processed in 48us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.075850:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789185607.075859:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789185607.075863:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3636:x1876096898361600:12345-0@lo:103: 00010000:00010000:0.0:1789185607.075869:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185607.075873:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72d00 expref: 22 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075880:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72d00 expref: 22 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075896:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a72d07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72d00 expref: 22 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.075903:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185607.075952:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3636:x1876096898361600:12345-0@lo:103: Request processed in 87us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.075958:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185607.076277:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185607.076400:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898361600:0@lo:103: 00000100:00100000:3.0:1789185607.076430:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898361216 00000100:00100000:3.0:1789185607.076435:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898361216 00000100:00100000:3.0:1789185607.076456:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898362112 00000100:00100000:3.0:1789185607.076459:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898362112 00000100:00100000:3.0:1789185607.076468:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898362240 00000100:00100000:3.0:1789185607.076470:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898362240 00000100:00100000:3.0:1789185607.076481:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185607.076487:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+5:10330:x1876096898361216:12345-0@lo:104: 00010000:00010000:3.0:1789185607.076498:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076554:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185607.076559:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+5:10330:x1876096898361216:12345-0@lo:104: Request processed in 73us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.076564:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185607.076577:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789185607.076583:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:10330:x1876096898362112:12345-0@lo:104: 00010000:00010000:3.0:1789185607.076591:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076622:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789185607.076627:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:10330:x1876096898362112:12345-0@lo:104: Request processed in 45us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.076642:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789185607.076654:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789185607.076660:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:10330:x1876096898362240:12345-0@lo:104: 00010000:00010000:3.0:1789185607.076668:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076699:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789185607.076704:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:10330:x1876096898362240:12345-0@lo:104: Request processed in 45us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.076709:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789185607.076725:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789185607.076729:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076736:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf600 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185607.076740:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076748:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185607.076755:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185607.076761:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185607.076788:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076794:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185607.076812:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076818:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300ddf600/0xda5c730d5a72c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ca5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076830:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185607.076833:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076839:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185607.076841:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076847:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185607.076853:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185607.076857:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185607.076870:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076876:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185607.076885:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076891:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a72c5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c66 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.076899:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789185607.077210:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898361984 00000100:00100000:0.0:1789185607.077215:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898361984 00010000:00010000:0.0:1789185607.077232:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72cac expref: 21 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.077246:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185607.077252:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3636:x1876096898361472:12345-0@lo:103: 00010000:00010000:0.0:1789185607.077260:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185607.077265:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72d1c expref: 21 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.077273:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72d1c expref: 21 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.077284:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300dde000/0xda5c730d5a72d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72d1c expref: 21 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.077293:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185607.077493:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:3636:x1876096898361472:12345-0@lo:103: Request processed in 241us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.077500:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185607.077513:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789185607.077537:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3636:x1876096898361984:12345-0@lo:103: 00010000:00010000:0.0:1789185607.077545:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185607.077550:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72cac expref: 19 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.077559:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72cac expref: 19 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.077568:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30da200/0xda5c730d5a72cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72cac expref: 19 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.077578:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185607.077601:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3636:x1876096898361984:12345-0@lo:103: Request processed in 75us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.077606:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789185607.077661:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898361216:0@lo:104: 00000100:00100000:0.0:1789185607.077670:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898362112:0@lo:104: 00000100:00100000:0.0:1789185607.077677:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898362240:0@lo:104: 00000100:00100000:2.0:1789185607.077800:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185607.077813:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898362368:0@lo:103: 00000100:00100000:2.0:1789185607.077843:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185607.077874:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898362368 00000100:00100000:2.0:1789185607.077877:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898362368 00010000:00010000:2.0:1789185607.077891:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c9e expref: 18 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185607.077946:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185607.077952:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:3635:x1876096898362368:12345-0@lo:103: 00010000:00010000:2.0:1789185607.077959:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185607.077963:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c9e expref: 18 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185607.078565:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72c9e expref: 18 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185607.078580:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166c400/0xda5c730d5a72ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72c9e expref: 18 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185607.078594:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185607.078637:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:3635:x1876096898362368:12345-0@lo:103: Request processed in 686us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185607.078643:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185607.078681:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898362368:0@lo:103: 00000100:00100000:0.0:1789185607.079146:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898362496:0@lo:103: 00000100:00100000:0.0:1789185607.079183:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185607.079224:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898362496 00000100:00100000:0.0:1789185607.079229:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898362496 00010000:00010000:0.0:1789185607.079253:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c5f expref: 17 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.079280:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789185607.079288:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:3637:x1876096898362496:12345-0@lo:103: 00010000:00010000:0.0:1789185607.079297:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185607.079450:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.079461:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185607.079465:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.079474:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185607.079480:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185607.079486:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185607.079516:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.079522:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185607.079836:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.079845:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30dba00/0xda5c730d5a72c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c3c expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.079863:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185607.079865:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185607.079867:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185607.079891:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898361472:0@lo:103: 00000100:00100000:3.0:1789185607.079900:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898361984:0@lo:103: 00010000:00010000:0.0:1789185607.080219:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c5f expref: 17 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.080229:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72c5f expref: 17 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.080241:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0030000/0xda5c730d5a72c66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72c5f expref: 17 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.080252:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185607.080288:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3637:x1876096898362496:12345-0@lo:103: Request processed in 1002us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.080295:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789185607.081293:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185607.081324:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898362624:0@lo:103: 00000100:00100000:0.0:1789185607.081373:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185607.081419:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898361728:0@lo:103: 00000100:00100000:0.0:1789185607.081429:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898361344:0@lo:103: 00000100:00100000:0.0:1789185607.081436:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898361856:0@lo:103: 00010000:00010000:0.0:1789185607.081458:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185607.081552:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898362496:0@lo:103: 00000100:00100000:2.0:1789185607.081933:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898362624 00000100:00100000:2.0:1789185607.081941:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898362624 00010000:00010000:2.0:1789185607.081974:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c35 expref: 16 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185607.082007:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789185607.082016:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+16:3638:x1876096898362624:12345-0@lo:103: 00010000:00010000:2.0:1789185607.082028:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185607.082033:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c35 expref: 16 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185607.082043:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72c35 expref: 16 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185607.082058:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72c35 expref: 16 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185607.082072:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185607.082117:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+15:3638:x1876096898362624:12345-0@lo:103: Request processed in 102us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185607.082124:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789185607.082205:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898362624:0@lo:103: 00000100:00100000:0.0:1789185607.083949:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360192:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185607.085876:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185607.086019:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185607.086054:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879432320 00000100:00100000:1.0:1789185607.086063:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879432320 00010000:00010000:1.0:1789185607.086102:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c88 expref: 10 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185607.086133:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879432448 00000100:00100000:1.0:1789185607.086136:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879432448 00010000:00010000:1.0:1789185607.086147:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c81 expref: 11 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185607.086164:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:1.0:1789185607.086172:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:2391:x1876096879432320:12345-192.168.204.48@tcp:103: 00010000:00010000:1.0:1789185607.086187:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185607.086193:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c88 expref: 11 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086205:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c88 expref: 11 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086222:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddf000/0xda5c730d5a72d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c88 expref: 11 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086238:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185607.086313:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879432320:12345-192.168.204.48@tcp:103: Request processed in 141us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185607.086321:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:1.0:1789185607.086340:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 34 00000100:00100000:1.0:1789185607.086347:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:2391:x1876096879432448:12345-192.168.204.48@tcp:103: 00010000:00010000:1.0:1789185607.086354:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185607.086358:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c81 expref: 9 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086368:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c81 expref: 9 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086380:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086389:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086405:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086412:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086418:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086424:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086430:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030e00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185607.086440:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086448:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086457:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185607.086468:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185607.086488:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:2391:x1876096879432448:12345-192.168.204.48@tcp:103: Request processed in 142us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185607.086494:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 34 00010000:00010000:0.0:1789185607.087244:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30da800/0xda5c730d5a72d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51c81 expref: 8 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185607.087259:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1876096898360320:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185607.087312:0:10330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.087344:0:10330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.087350:0:10330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185607.087355:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72da1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185607.257280:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185607.257348:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879432576 00000100:00100000:3.0:1789185607.257358:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879432576 00000100:00100000:3.0:1789185607.257437:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 203 00000100:00100000:3.0:1789185607.257448:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:6163:x1876096879432576:12345-192.168.204.48@tcp:101: 00010000:00010000:3.0:1789185607.257467:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185607.257486:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c13a3000/0xda5c730d5a72da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51cf8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.257512:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c13a3000/0xda5c730d5a72da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cf8 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.257534:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c13a3000/0xda5c730d5a72da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cf8 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185607.257543:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c13a3000, rc 0) 00000100:00100000:3.0:1789185607.257599:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6163:x1876096879432576:12345-192.168.204.48@tcp:101: Request processed in 153us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185607.257607:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 203 00000100:00100000:1.0:1789185607.273669:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185607.273704:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879432704 00000100:00100000:1.0:1789185607.273714:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879432704 00000100:00100000:1.0:1789185607.273757:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 204 00000100:00100000:1.0:1789185607.273767:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6163:x1876096879432704:12345-192.168.204.48@tcp:501: 00000100:00100000:1.0:1789185607.273926:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6163:x1876096879432704:12345-192.168.204.48@tcp:501: Request processed in 144us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185607.274609:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 204 00000100:00100000:1.0:1789185607.279134:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185607.279828:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879432832 00000100:00100000:2.0:1789185607.279841:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879432832 00000100:00100000:2.0:1789185607.279899:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 205 00000100:00100000:2.0:1789185607.280004:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6163:x1876096879432832:12345-192.168.204.48@tcp:503: 00000100:00100000:2.0:1789185607.280187:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6163:x1876096879432832:12345-192.168.204.48@tcp:503: Request processed in 187us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185607.280196:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 205 00000100:00100000:1.0:1789185607.286198:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185607.286297:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879432960 00000100:00100000:2.0:1789185607.286321:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879432960 00000100:00100000:2.0:1789185607.286379:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 206 00000100:00100000:2.0:1789185607.286390:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6639:x1876096879432960:12345-192.168.204.48@tcp:502: 00000100:00100000:2.0:1789185607.286655:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6639:x1876096879432960:12345-192.168.204.48@tcp:502: Request processed in 266us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185607.286664:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 206 00000100:00100000:3.0:1789185607.289782:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185607.291459:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879433088 00000100:00100000:1.0:1789185607.291477:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879433088 00000100:00100000:1.0:1789185607.291674:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 207 00000100:00100000:1.0:1789185607.291687:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6639:x1876096879433088:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185607.291941:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6639:x1876096879433088:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 256us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185607.291951:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 207 00000100:00100000:1.0:1789185607.296085:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185607.296231:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879433216 00000100:00100000:2.0:1789185607.296241:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879433216 00000100:00100000:2.0:1789185607.296300:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 208 00000100:00100000:2.0:1789185607.296311:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6163:x1876096879433216:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185607.296331:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185607.296351:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72daf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51cff expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185607.296382:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cff expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185607.296394:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cff expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185607.296404:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf400, rc 0) 00000100:00100000:2.0:1789185607.296466:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6163:x1876096879433216:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 Request processed in 157us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185607.296472:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 208 00000100:00100000:0.0:1789185607.298854:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185607.298961:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879433344 00000100:00100000:1.0:1789185607.299068:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879433344 00000100:00100000:1.0:1789185607.299115:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 209 00000100:00100000:1.0:1789185607.299125:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6163:x1876096879433344:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185607.299355:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6163:x1876096879433344:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 Request processed in 231us (508us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789185607.299364:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 209 00000100:00100000:2.0:1789185607.590403:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898362880:0@lo:13: 00000100:00100000:2.0:1789185607.590473:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185607.590491:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898362752:0@lo:13: 00000100:00100000:0.0:1789185607.590532:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185607.590576:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898362880 00000100:00100000:0.0:1789185607.590583:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898362880 00000100:00100000:1.0:1789185607.590612:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898362752 00000100:00100000:1.0:1789185607.590617:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898362752 00000100:00100000:0.0:1789185607.590648:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185607.590657:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898362880:12345-0@lo:13: 00000100:00080000:2.0:1789185607.590663:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789185607.590935:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185607.590999:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898362880:12345-0@lo:13: Request processed in 334us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.591005:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789185607.591015:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7494700 x1876096898362880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185607.591022:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789185607.591028:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898362752:12345-0@lo:13: 00000100:00100000:2.0:1789185607.591032:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898362880:0@lo:13: 00002000:00000024:0.0:1789185607.591038:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185607.591067:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898362752:12345-0@lo:13: Request processed in 39us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185607.591073:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789185607.591076:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b5180 x1876096898362752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185607.591088:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898362752:0@lo:13: 00010000:00010000:3.0:1789185607.974150:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185608.038351:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185608.038407:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185608.038448:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185608.038471:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185608.038501:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879433856 00000100:00100000:3.0:1789185608.038528:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879433856 00000100:00100000:3.0:1789185608.038586:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879433728 00000100:00100000:3.0:1789185608.038589:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879433728 00000100:00100000:3.0:1789185608.038614:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:3.0:1789185608.038640:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879433856:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185608.038714:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879433856:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.038722:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:3.0:1789185608.038739:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:3.0:1789185608.038746:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879433728:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185608.038770:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879433728:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.038777:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00080000:3.0:1789185608.038798:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789185608.038803:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185608.039324:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879433600 00000100:00100000:1.0:1789185608.039330:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879433600 00000100:00100000:1.0:1789185608.039394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879433472 00000100:00100000:1.0:1789185608.039398:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879433472 00000100:00100000:1.0:1789185608.039419:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:1.0:1789185608.039426:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879433600:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185608.039466:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879433600:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 37us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.039466:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00100000:0.0:1789185608.039672:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879433472:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185608.039702:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:0.0:1789185608.039727:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879433472:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 232us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.039736:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00080000:0.0:1789185608.041316:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185608.041326:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 10000000:01000000:1.0:1789185608.619582:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789185608.619590:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2ff976000 from 48 10000000:01000000:1.0:1789185608.619595:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789185608.619648:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.619690:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.619702:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.619726:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363008:0@lo:101: 00000100:00100000:1.0:1789185608.619790:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.619839:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185608.621941:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898363008 00000100:00100000:3.0:1789185608.621956:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898363008 00000100:00100000:3.0:1789185608.622026:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789185608.622037:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+15:6509:x1876096898363008:12345-0@lo:101: 00010000:00010000:3.0:1789185608.622058:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185608.622078:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c13a3400/0xda5c730d5a72dbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72db6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.622110:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c13a3400/0xda5c730d5a72dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72db6 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.622120:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c13a3400/0xda5c730d5a72dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72db6 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.622129:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c13a3400, rc 0) 00000100:00100000:3.0:1789185608.622203:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898363008:12345-0@lo:101: Request processed in 168us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.622220:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789185608.622409:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363008:0@lo:101: 00010000:00010000:2.0:1789185608.622428:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.622437:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185608.622526:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363136:0@lo:501: 00000100:00100000:2.0:1789185608.622559:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.623253:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5900 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.632104:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898363136 00000100:00100000:1.0:1789185608.632121:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898363136 00000100:00100000:1.0:1789185608.632197:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789185608.632207:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898363136:12345-0@lo:501: 00000100:00100000:1.0:1789185608.632386:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898363136:12345-0@lo:501: Request processed in 181us (9826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.632394:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789185608.632451:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363136:0@lo:501: 00000100:00100000:1.0:1789185608.632509:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363264:0@lo:503: 00000100:00100000:1.0:1789185608.632565:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.632586:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.632599:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898363264 00000100:00100000:1.0:1789185608.632603:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898363264 00000100:00100000:1.0:1789185608.632621:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789185608.632626:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898363264:12345-0@lo:503: 00000100:00100000:1.0:1789185608.632698:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898363264:12345-0@lo:503: Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.632713:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789185608.632751:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363264:0@lo:503: 00000100:00100000:0.0:1789185608.636114:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10352:1876096898363392:0@lo:502: 00000100:00100000:0.0:1789185608.636198:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185608.636236:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.636375:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898363392 00000100:00100000:1.0:1789185608.636383:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898363392 00000100:00100000:1.0:1789185608.636434:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789185608.636443:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:10352:x1876096898363392:12345-0@lo:502: 00000100:00100000:1.0:1789185608.636589:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:10352:x1876096898363392:12345-0@lo:502: Request processed in 146us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.636596:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789185608.636806:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10352:1876096898363392:0@lo:502: 00000100:00100000:3.0:1789185608.636852:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10352:1876096898363520:0@lo:502: 00000100:00100000:3.0:1789185608.636887:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185608.636936:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d12240 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.637012:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898363520 00000100:00100000:1.0:1789185608.637017:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898363520 00000100:00100000:1.0:1789185608.637048:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789185608.637055:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:10352:x1876096898363520:12345-0@lo:502: 00000100:00100000:1.0:1789185608.637124:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+16:10352:x1876096898363520:12345-0@lo:502: Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.637130:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789185608.637250:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10352:1876096898363520:0@lo:502: 00000040:00080000:3.0:1789185608.637270:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789185608.640884:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789185608.640982:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185608.640995:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.641008:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185608.641019:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789185608.641022:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789185608.641024:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789185608.641070:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.641079:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.641089:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.641111:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363648:0@lo:101: 00000100:00100000:1.0:1789185608.641180:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.641225:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f28c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.641425:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898363648 00000100:00100000:0.0:1789185608.641432:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898363648 00000100:00100000:0.0:1789185608.641485:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789185608.641504:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+16:6509:x1876096898363648:12345-0@lo:101: 00010000:00010000:0.0:1789185608.641517:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185608.641531:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a72dcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72dc4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.641554:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a72dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72dc4 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.641566:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a72dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72dc4 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.641574:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0030c00, rc 0) 00000100:00100000:0.0:1789185608.641614:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898363648:12345-0@lo:101: Request processed in 120us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.641621:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789185608.641847:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363648:0@lo:101: 00010000:00010000:1.0:1789185608.641862:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.641871:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.641970:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363776:0@lo:501: 00000100:00100000:1.0:1789185608.642011:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.642041:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f28c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.642068:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898363776 00000100:00100000:0.0:1789185608.642081:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898363776 00000100:00100000:0.0:1789185608.642118:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789185608.642124:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898363776:12345-0@lo:501: 00000100:00100000:0.0:1789185608.642319:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898363776:12345-0@lo:501: Request processed in 194us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.642326:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789185608.642412:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363776:0@lo:501: 00000100:00100000:1.0:1789185608.642439:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363904:0@lo:503: 00000100:00100000:1.0:1789185608.642484:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.642517:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f28c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.642562:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898363904 00000100:00100000:0.0:1789185608.642567:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898363904 00000100:00100000:0.0:1789185608.642598:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789185608.642604:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898363904:12345-0@lo:503: 00000100:00100000:0.0:1789185608.642690:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898363904:12345-0@lo:503: Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.642696:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789185608.642774:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898363904:0@lo:503: 00000100:00100000:1.0:1789185608.643843:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10353:1876096898364032:0@lo:502: 00000100:00100000:1.0:1789185608.643896:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.643962:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce257480 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.647256:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898364032 00000100:00100000:0.0:1789185608.647271:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898364032 00000100:00100000:0.0:1789185608.647341:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789185608.647352:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:10353:x1876096898364032:12345-0@lo:502: 00000100:00100000:0.0:1789185608.647553:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+17:10353:x1876096898364032:12345-0@lo:502: Request processed in 202us (3655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.647560:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789185608.647672:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10353:1876096898364032:0@lo:502: 00000020:01000000:2.0:1789185608.647722:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185608.647731:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185608.647734:0:10353:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789185608.647739:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789185608.647772:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10353:1876096898364160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185608.647816:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.647852:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5900 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.648255:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898364160 00000100:00100000:0.0:1789185608.648262:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898364160 00000100:00100000:0.0:1789185608.648294:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789185608.648301:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:10353:x1876096898364160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185608.648373:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:10353:x1876096898364160:12345-0@lo:502:llog_process_th.0 Request processed in 71us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.648379:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789185608.649783:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10353:1876096898364160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185608.649828:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185608.649834:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185608.649836:0:10353:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789185608.649840:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1789185608.650143:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789185608.650169:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789185608.650182:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.650195:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185608.650206:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789185608.650208:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2d26ca000 from 48 10000000:01000000:1.0:1789185608.650211:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789185608.650243:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.650251:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.650259:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.650279:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898364288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.650331:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.650363:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.650939:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898364288 00000100:00100000:0.0:1789185608.650947:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898364288 00000100:00100000:0.0:1789185608.651615:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789185608.651626:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+17:6509:x1876096898364288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185608.651642:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185608.651658:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72dd2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.651684:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72dd2 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.651694:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72dd2 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.651702:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0030e00, rc 0) 00000100:00100000:0.0:1789185608.651763:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898364288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.651770:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789185608.651821:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898364288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185608.651838:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.651848:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185608.651949:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898364416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.654154:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185608.654204:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185608.654349:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898364416 00000100:00100000:2.0:1789185608.654358:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898364416 00000100:00100000:2.0:1789185608.654403:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789185608.654412:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898364416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.654571:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898364416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185608.654579:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789185608.654685:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898364416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.654730:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898364544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.654775:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.654803:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.657236:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898364544 00000100:00100000:0.0:1789185608.657251:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898364544 00000100:00100000:0.0:1789185608.657320:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789185608.657331:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898364544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.657516:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898364544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.657522:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789185608.657775:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898364544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.663314:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10355:1876096898364672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185608.663416:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.663453:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.664132:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898364672 00000100:00100000:0.0:1789185608.664141:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898364672 00000100:00100000:0.0:1789185608.664192:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789185608.664202:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:10355:x1876096898364672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185608.664338:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+18:10355:x1876096898364672:12345-0@lo:502:llog_process_th.0 Request processed in 137us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.664346:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789185608.664481:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10355:1876096898364672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185608.664543:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10355:1876096898364800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185608.664580:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.664600:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.664651:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898364800 00000100:00100000:0.0:1789185608.664656:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898364800 00000100:00100000:0.0:1789185608.664688:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789185608.664695:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:10355:x1876096898364800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185608.664759:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+18:10355:x1876096898364800:12345-0@lo:502:llog_process_th.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.664766:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789185608.664842:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10355:1876096898364800:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789185608.664865:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789185608.665169:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789185608.665191:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789185608.665200:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.665211:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185608.665229:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789185608.665231:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789185608.665234:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789185608.665261:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.665270:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.665279:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185608.665295:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898364928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.665325:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185608.665392:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185608.677378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898364928 00000100:00100000:2.0:1789185608.677398:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898364928 00000100:00100000:2.0:1789185608.677460:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789185608.677470:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+18:6509:x1876096898364928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185608.677487:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185608.677517:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddea00/0xda5c730d5a72de7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72de0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.677545:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddea00/0xda5c730d5a72de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72de0 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.677557:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddea00/0xda5c730d5a72de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72de0 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.677566:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddea00, rc 0) 00000100:00100000:2.0:1789185608.677634:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898364928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (12308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185608.677641:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789185608.677699:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898364928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185608.677718:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.677728:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185608.677801:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.677850:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.677889:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.678060:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898365056 00000100:00100000:0.0:1789185608.678065:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898365056 00000100:00100000:0.0:1789185608.678096:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789185608.678104:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898365056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.678230:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898365056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.678237:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789185608.678564:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.678600:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.678653:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.680824:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.681153:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898365184 00000100:00100000:0.0:1789185608.681164:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898365184 00000100:00100000:0.0:1789185608.681223:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789185608.681233:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898365184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.683855:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898365184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2614us (5191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.683885:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789185608.687548:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.687801:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10357:1876096898365312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185608.687873:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.687932:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898365312 00000100:00100000:2.0:1789185608.687939:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898365312 00000100:00100000:2.0:1789185608.687984:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789185608.687993:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:10357:x1876096898365312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185608.688113:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+19:10357:x1876096898365312:12345-0@lo:502:llog_process_th.0 Request processed in 120us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185608.688121:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789185608.688172:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789185608.688184:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10357:1876096898365312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185608.688205:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185608.688213:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185608.688216:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789185608.688221:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789185608.688240:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10357:1876096898365440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185608.688271:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.688300:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.688478:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898365440 00000100:00100000:1.0:1789185608.688483:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898365440 00000100:00100000:1.0:1789185608.688522:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789185608.688530:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:10357:x1876096898365440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185608.688598:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:10357:x1876096898365440:12345-0@lo:502:llog_process_th.0 Request processed in 69us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.688612:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789185608.688791:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10357:1876096898365440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185608.688810:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185608.688814:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185608.688816:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789185608.688820:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789185608.689125:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789185608.689146:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789185608.689156:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.689168:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185608.689178:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789185608.689182:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f30030e800 from 48 10000000:01000000:1.0:1789185608.689186:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789185608.689214:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.689223:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.689232:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.689247:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.689279:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.689300:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.689409:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898365568 00000100:00100000:1.0:1789185608.689414:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898365568 00000100:00100000:1.0:1789185608.689442:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789185608.689449:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+19:6509:x1876096898365568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185608.689469:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185608.689487:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf8c00/0xda5c730d5a72df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72dee expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.689521:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf8c00/0xda5c730d5a72df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72dee expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.689532:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf8c00/0xda5c730d5a72df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72dee expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.689542:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8c00, rc 0) 00000100:00100000:1.0:1789185608.689572:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898365568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.689579:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789185608.689610:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185608.689623:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.689633:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.689680:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.689703:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.689714:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.689724:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898365696 00000100:00100000:1.0:1789185608.689727:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898365696 00000100:00100000:1.0:1789185608.689745:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789185608.689750:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898365696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.689843:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898365696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.689856:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789185608.689884:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.689928:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.689961:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.689974:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.689984:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898365824 00000100:00100000:1.0:1789185608.689988:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898365824 00000100:00100000:1.0:1789185608.690008:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789185608.690013:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898365824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.690082:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898365824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.690089:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789185608.690125:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898365824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185608.693872:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10358:1876096898365952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185608.694011:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185608.694060:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.694160:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898365952 00000100:00100000:1.0:1789185608.694173:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898365952 00000100:00100000:1.0:1789185608.694241:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789185608.694253:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:10358:x1876096898365952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185608.694415:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:10358:x1876096898365952:12345-0@lo:502:llog_process_th.0 Request processed in 164us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.694424:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789185608.695961:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10358:1876096898365952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185608.696050:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10358:1876096898366080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185608.696122:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185608.696157:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.696321:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898366080 00000100:00100000:1.0:1789185608.696329:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898366080 00000100:00100000:1.0:1789185608.696377:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789185608.696397:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+20:10358:x1876096898366080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185608.696673:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+20:10358:x1876096898366080:12345-0@lo:502:llog_process_th.0 Request processed in 276us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.696682:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789185608.696869:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10358:1876096898366080:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789185608.696893:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789185608.697300:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789185608.697342:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185608.697353:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.697366:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185608.697377:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789185608.697379:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1789185608.697549:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789185608.697584:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.697593:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.697603:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.697623:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.697827:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.697870:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185608.698071:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898366208 00000100:00100000:3.0:1789185608.698080:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898366208 00000100:00100000:3.0:1789185608.698208:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789185608.698220:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898366208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185608.698232:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185608.698250:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c13a3e00/0xda5c730d5a72e03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72dfc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.698290:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c13a3e00/0xda5c730d5a72e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72dfc expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.698301:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c13a3e00/0xda5c730d5a72e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72dfc expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.698311:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c13a3e00, rc 0) 00000100:00100000:3.0:1789185608.698363:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898366208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.698370:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789185608.698450:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185608.698479:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.698490:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185608.698569:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.698598:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.701422:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.701657:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898366336 00000100:00100000:0.0:1789185608.701666:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898366336 00000100:00100000:1.0:1789185608.702087:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789185608.702099:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898366336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.702286:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898366336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (3685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.702293:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789185608.705801:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.705877:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.705983:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.706220:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.709770:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898366464 00000100:00100000:0.0:1789185608.709791:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898366464 00000100:00100000:0.0:1789185608.709869:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789185608.709880:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898366464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.710571:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898366464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 691us (4595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.710580:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789185608.711151:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.724218:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10359:1876096898366592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185608.724320:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.724375:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185608.725089:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898366592 00000100:00100000:3.0:1789185608.725099:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898366592 00000100:00100000:3.0:1789185608.725153:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789185608.725161:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:10359:x1876096898366592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185608.725307:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:10359:x1876096898366592:12345-0@lo:502:llog_process_th.0 Request processed in 146us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.725315:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789185608.725795:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10359:1876096898366592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789185608.725827:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185608.725837:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185608.725839:0:10359:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789185608.725846:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789185608.725875:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10359:1876096898366720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185608.726065:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.726092:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.726138:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898366720 00000100:00100000:0.0:1789185608.726145:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898366720 00000100:00100000:0.0:1789185608.726188:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789185608.726196:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:10359:x1876096898366720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185608.726312:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:10359:x1876096898366720:12345-0@lo:502:llog_process_th.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.726318:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789185608.726556:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10359:1876096898366720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789185608.726576:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185608.726581:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185608.726583:0:10359:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789185608.726588:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1789185608.726766:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1789185608.726794:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789185608.726807:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.726818:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185608.726834:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789185608.726837:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2e7ae1000 from 48 10000000:01000000:3.0:1789185608.726849:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789185608.726882:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.726892:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.726903:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185608.726959:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185608.727004:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185608.727023:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d12e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.727135:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898366848 00000100:00100000:0.0:1789185608.727141:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898366848 00000100:00100000:0.0:1789185608.727177:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789185608.727186:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898366848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185608.727197:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185608.727212:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0031400/0xda5c730d5a72e11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72e0a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.727241:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031400/0xda5c730d5a72e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72e0a expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.727261:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0031400/0xda5c730d5a72e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e0a expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.727271:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031400, rc 0) 00000100:00100000:0.0:1789185608.727312:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898366848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.727319:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789185608.728628:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185608.728651:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185608.728664:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185608.728757:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.728800:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.728827:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.728896:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898366976 00000100:00100000:0.0:1789185608.728902:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898366976 00000100:00100000:0.0:1789185608.728961:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789185608.729035:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898366976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.729174:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898366976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.729182:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789185608.729217:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898366976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.729246:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898367104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.729296:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185608.729308:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ab6180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.729320:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898367104 00000100:00100000:0.0:1789185608.729323:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898367104 00000100:00100000:0.0:1789185608.729341:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789185608.729347:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898367104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.729573:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898367104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.729580:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789185608.729622:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898367104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.729829:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10360:1876096898367232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185608.729861:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185608.729878:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898367232 00000100:00100000:0.0:1789185608.729881:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898367232 00000100:00100000:0.0:1789185608.729897:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789185608.729903:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:10360:x1876096898367232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185608.731114:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:10360:x1876096898367232:12345-0@lo:502:llog_process_th.0 Request processed in 1204us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.731125:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789185608.731168:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c0ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.731185:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10360:1876096898367232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185608.731240:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10360:1876096898367360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185608.731278:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185608.731341:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c0ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185608.744097:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898367360 00000100:00100000:3.0:1789185608.744113:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898367360 00000100:00100000:3.0:1789185608.744204:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789185608.744215:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:10360:x1876096898367360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185608.744429:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:10360:x1876096898367360:12345-0@lo:502:llog_process_th.0 Request processed in 215us (13150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.744437:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789185608.750959:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10360:1876096898367360:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789185608.751065:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789185608.753397:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789185608.753444:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789185608.753469:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.753483:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185608.753664:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789185608.753666:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789185608.753669:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789185608.753706:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.753714:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.753725:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185608.753750:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898367488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185608.753814:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185608.753870:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185608.753897:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898367488 00000100:00100000:2.0:1789185608.753904:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898367488 00000100:00100000:2.0:1789185608.754740:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789185608.754756:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898367488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185608.754773:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185608.754787:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddfe00/0xda5c730d5a72e1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72e18 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.754814:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddfe00/0xda5c730d5a72e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72e18 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.754825:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddfe00/0xda5c730d5a72e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e18 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185608.754848:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddfe00, rc 0) 00000100:00100000:2.0:1789185608.754935:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898367488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185608.754942:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789185608.755677:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898367488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185608.755701:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.755711:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185608.755794:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898367616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185608.755844:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185608.755887:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d12180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185608.755948:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898367616 00000100:00100000:3.0:1789185608.755954:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898367616 00000100:00100000:3.0:1789185608.757161:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789185608.757174:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898367616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185608.759096:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898367616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1915us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.759112:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789185608.763126:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898367616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.763287:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898367744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.763362:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185608.764585:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898367744 00000100:00100000:0.0:1789185608.764598:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898367744 00000100:00100000:0.0:1789185608.764659:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789185608.764668:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898367744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.764808:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898367744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.764815:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789185608.764940:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185608.764962:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898367744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185608.766895:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10361:1876096898367872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185608.767152:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.768527:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185608.775667:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898367872 00000100:00100000:3.0:1789185608.775684:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898367872 00000100:00100000:3.0:1789185608.775828:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789185608.775839:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:10361:x1876096898367872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185608.776085:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:10361:x1876096898367872:12345-0@lo:502:llog_process_th.0 Request processed in 247us (8932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185608.776093:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789185608.776216:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10361:1876096898367872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789185608.776253:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185608.776262:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185608.776265:0:10361:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789185608.776270:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789185608.776311:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10361:1876096898368000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185608.776357:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185608.785669:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.786200:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898368000 00000100:00100000:0.0:1789185608.786232:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898368000 00000100:00100000:0.0:1789185608.786286:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789185608.786297:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:10361:x1876096898368000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185608.786485:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:10361:x1876096898368000:12345-0@lo:502:llog_process_th.0 Request processed in 190us (10127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185608.788002:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10361:1876096898368000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789185608.788066:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185608.788080:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185608.788094:0:10361:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789185608.788101:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1789185608.789077:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000020:01000000:3.0:1789185608.789372:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1789185608.789654:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789185608.789669:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.789683:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185608.789697:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789185608.789699:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98f2c6fd4d40 from 1 10000000:01000000:3.0:1789185608.789702:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789185608.789743:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.789765:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.789776:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185608.789806:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898368128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185608.789873:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185608.790091:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898368128 00000100:00100000:0.0:1789185608.790098:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898368128 00000100:00100000:0.0:1789185608.790157:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789185608.790168:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898368128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185608.790183:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185608.790200:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0031800/0xda5c730d5a72e2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72e26 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.790228:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031800/0xda5c730d5a72e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72e26 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.790240:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0031800/0xda5c730d5a72e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e26 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.790250:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031800, rc 0) 00000100:00100000:0.0:1789185608.790295:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898368128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185608.790301:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789185608.790685:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d12180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185608.790712:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898368128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185608.790729:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185608.790739:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185608.790814:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898368256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185608.790847:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185608.790862:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d12180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185608.793566:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898368256 00000100:00100000:0.0:1789185608.793589:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898368256 00000100:00100000:0.0:1789185608.793680:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789185608.793689:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898368256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185608.793843:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898368256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (2993us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185608.793851:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789185608.793937:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898368256:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789185608.793978:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789185608.793987:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185608.793998:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.001350:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789185609.501424:0:10392:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1c4c0bd0 20000000:00000080:0.0:1789185609.501450:0:10392:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f300ff8c00 uarg=0000000000000000 20000000:01000000:0.0:1789185609.501594:0:10392:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789185609.501602:0:10392:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789185609.501607:0:10392:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789185609.502600:0:10393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789185609.502883:0:10392:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789185609.512183:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789185609.512223:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789185609.512235:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789185609.512255:0:10392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789185609.513151:0:10392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.513607:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166d400/0xda5c730d5a72ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ac9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.513617:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ad7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.513649:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72b2b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.513657:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72c51 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.513668:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cc0 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.513677:0:10392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.513902:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cc0 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.513952:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cc0 expref: 9 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185609.513972:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368384:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185609.514112:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72c51 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.514121:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72c51 expref: 23 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185609.514130:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368512:0@lo:104: 00000100:00100000:1.0:1789185609.514181:0:10392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185609.514239:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72b2b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.514247:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72b2b expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185609.514255:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368640:0@lo:104: 00000100:00100000:1.0:1789185609.514355:0:10392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185609.514381:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72ad7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.514446:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72ad7 expref: 23 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.514701:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789185609.514719:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898368512 00000100:00100000:2.0:1789185609.514727:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898368512 00000100:00100000:2.0:1789185609.514777:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898368640 00000100:00100000:2.0:1789185609.514780:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898368640 00000100:00100000:2.0:1789185609.514796:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789185609.514806:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:10392:x1876096898368512:12345-0@lo:104: 00010000:00010000:2.0:1789185609.514822:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.514882:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185609.514889:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:10392:x1876096898368512:12345-0@lo:104: Request processed in 84us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.514896:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789185609.514944:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789185609.514951:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:10392:x1876096898368640:12345-0@lo:104: 00010000:00010000:2.0:1789185609.514959:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.515007:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789185609.515012:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:10392:x1876096898368640:12345-0@lo:104: Request processed in 63us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.515031:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789185609.515163:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368768:0@lo:104: 00000100:00100000:1.0:1789185609.515195:0:10392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185609.515232:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166d400/0xda5c730d5a72ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72ac9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.515240:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166d400/0xda5c730d5a72ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72ac9 expref: 23 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185609.515248:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300251c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368896:0@lo:104: 00000100:00100000:1.0:1789185609.515267:0:10392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.515558:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898368768 00000100:00100000:0.0:1789185609.515563:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898368768 00000100:00100000:2.0:1789185609.515599:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898368896 00000100:00100000:2.0:1789185609.515604:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898368896 00000100:00100000:2.0:1789185609.515639:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789185609.515646:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:10392:x1876096898368896:12345-0@lo:104: 00010000:00010000:2.0:1789185609.515655:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.515700:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789185609.515709:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:10392:x1876096898368896:12345-0@lo:104: Request processed in 63us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.515715:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789185609.515867:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789185609.515876:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300250380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:10392:x1876096898368768:12345-0@lo:104: 00010000:00010000:0.0:1789185609.515886:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.515969:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789185609.515974:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300250380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:10392:x1876096898368768:12345-0@lo:104: Request processed in 102us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185609.515981:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789185609.516001:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789185609.516008:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516016:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185609.516028:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516038:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185609.516047:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185609.516054:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789185609.516092:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516100:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185609.516128:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516135:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30db400/0xda5c730d5a72c51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72c58 expref: -99 pid: 9506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516153:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789185609.516157:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516164:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfc00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185609.516167:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516174:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185609.516179:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185609.516192:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789185609.516208:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516214:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185609.516220:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516226:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300ddfc00/0xda5c730d5a72b2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72b32 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516236:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185609.516239:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516244:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddec00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185609.516247:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516252:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185609.516258:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185609.516263:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789185609.516289:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516295:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185609.516329:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516336:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300ddec00/0xda5c730d5a72ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ad0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516347:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185609.516350:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516356:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185609.516359:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.516366:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185609.516373:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185609.516378:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789185609.516388:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898369280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185609.516433:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.516506:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898369280 00000100:00100000:2.0:1789185609.516513:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898369280 00000100:00100000:1.0:1789185609.516652:0:10392:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4bd80 going to sleep for 11 seconds 00010000:00010000:2.0:1789185609.516662:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166d400/0xda5c730d5a72ad0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ac9 expref: 24 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.516693:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789185609.516700:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898369280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185609.516715:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185609.516721:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166d400/0xda5c730d5a72ad0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ac9 expref: 24 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.516730:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166d400/0xda5c730d5a72ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72ac9 expref: 24 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.516761:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185609.516895:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368512:0@lo:104: 00010000:00010000:0.0:1789185609.517050:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.517057:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185609.517070:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.517078:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a72ad7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ade expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.517094:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185609.517102:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185609.517104:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185609.517113:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185609.517119:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185609.517141:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898369024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185609.517267:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898369280:12345-0@lo:103:ldlm_bl.0 Request processed in 567us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.517275:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1789185609.517675:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185609.517858:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368640:0@lo:104: 00000100:00100000:1.0:1789185609.517870:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368768:0@lo:104: 00010000:00010000:1.0:1789185609.517879:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166d400/0xda5c730d5a72ad0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72ac9 expref: 23 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185609.517891:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300251c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368896:0@lo:104: 00000100:00100000:1.0:1789185609.517978:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898369408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185609.518202:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898369280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185609.518452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.518609:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898369408 00000100:00100000:2.0:1789185609.518617:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898369408 00010000:00010000:2.0:1789185609.518655:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ad7 expref: 23 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.518691:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789185609.518700:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3636:x1876096898369408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185609.518714:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185609.518720:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ad7 expref: 23 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.518729:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72ad7 expref: 23 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.518747:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72ade lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72ad7 expref: 23 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.518760:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185609.518803:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3636:x1876096898369408:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.518810:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789185609.518868:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898369408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185609.518896:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898369152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185609.518967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.519210:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.519263:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898369152 00000100:00100000:0.0:1789185609.519269:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898369152 00010000:00010000:0.0:1789185609.519357:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b2b expref: 22 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185609.519373:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898369024 00000100:00100000:0.0:1789185609.519376:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898369024 00010000:00010000:0.0:1789185609.519447:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c51 expref: 23 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185609.519463:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789185609.519471:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3638:x1876096898369152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185609.519551:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185609.519557:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72b2b expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.519566:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72b2b expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.519678:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789185609.519690:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789185609.519762:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30dac00/0xda5c730d5a72b32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72b2b expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.519779:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185609.519818:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3638:x1876096898369152:12345-0@lo:103:ldlm_bl.0 Request processed in 349us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185609.519834:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789185609.520125:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789185609.520583:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789185609.520605:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3637:x1876096898369024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185609.520619:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185609.520624:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72c51 expref: 21 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.520634:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72c51 expref: 21 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.520647:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72c58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72c51 expref: 21 pid: 6506 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.520659:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185609.520709:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:3637:x1876096898369024:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.520716:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789185609.522601:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898369152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185609.522662:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898369024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185609.528286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185609.528642:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876096898368384:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185609.529052:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879433984 00000100:00100000:3.0:1789185609.529063:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879433984 00010000:00010000:3.0:1789185609.529119:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cc0 expref: 10 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.529183:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 39 00000100:00100000:3.0:1789185609.529196:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879433984:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185609.529217:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185609.529225:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cc0 expref: 10 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.529237:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cc0 expref: 10 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.529259:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72d70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cc0 expref: 10 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.529266:0:10392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.529281:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.529290:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.535814:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.535840:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.535849:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.535858:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.535898:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185609.535903:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.536146:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.536302:0:10392:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185609.536312:0:10392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.537230:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.537248:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031600/0xda5c730d5a72e34 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.537273:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185609.537375:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:2391:x1876096879433984:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 8172us (9097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.537388:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 39 10000000:01000000:0.0:1789185609.902040:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789185609.902049:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2ff976000 from 4 10000000:01000000:0.0:1789185609.902054:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185609.902108:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.902120:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.902132:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185609.902159:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898369536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.902237:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.902382:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c31386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185609.905791:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898369536 00000100:00100000:3.0:1789185609.905809:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898369536 00000100:00100000:3.0:1789185609.905978:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789185609.905991:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898369536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185609.906012:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185609.906038:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72e3b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.906072:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72e3b expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.906087:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e3b expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.906112:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166c000, rc 0) 00000100:00100000:3.0:1789185609.906187:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898369536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.906194:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789185609.906290:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898369536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185609.906310:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185609.906320:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185609.906395:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898369664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.906423:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.914194:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c31386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185609.914375:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898369664 00000100:00100000:1.0:1789185609.914387:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898369664 00000100:00100000:1.0:1789185609.917382:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789185609.917410:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898369664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185609.918002:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898369664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 604us (11576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185609.918011:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789185609.922011:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898369664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.922085:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898369792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.922168:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.922206:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c31386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185609.922359:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898369792 00000100:00100000:1.0:1789185609.922367:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898369792 00000100:00100000:1.0:1789185609.922441:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789185609.922452:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898369792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185609.922585:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898369792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185609.922592:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789185609.922882:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898369792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.923874:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10406:1876096898369920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185609.923964:0:10406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.923995:0:10406:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138840 going to sleep for 11 seconds 00000100:00100000:1.0:1789185609.924053:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898369920 00000100:00100000:1.0:1789185609.924059:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898369920 00000100:00100000:1.0:1789185609.924099:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789185609.924107:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:10406:x1876096898369920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185609.924216:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:10406:x1876096898369920:12345-0@lo:502:llog_process_th.0 Request processed in 109us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185609.924317:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10406:1876096898369920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185609.924344:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185609.924355:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185609.924357:0:10406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789185609.924365:0:10406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f2ff976000 00000020:00000080:0.0:1789185609.924368:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789185609.926627:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789185609.926871:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10406:1876096898370048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185609.926960:0:10406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185609.927003:0:10406:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185609.927075:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898370048 00000100:00100000:3.0:1789185609.927083:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898370048 00000100:00100000:3.0:1789185609.927131:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789185609.927141:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:10406:x1876096898370048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185609.927291:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:10406:x1876096898370048:12345-0@lo:502:llog_process_th.0 Request processed in 151us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.927299:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789185609.927585:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10406:1876096898370048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789185609.927616:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185609.927625:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185609.927628:0:10406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789185609.927632:0:10406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789185609.928812:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789185609.928837:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185609.928848:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.928860:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185609.928871:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185609.928875:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2d26ca000 from 4 10000000:01000000:3.0:1789185609.928877:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185609.928945:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.928954:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.928982:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.929007:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185609.929065:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185609.929815:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d12300 going to sleep for 11 seconds 00000100:00100000:2.0:1789185609.942556:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898370176 00000100:00100000:2.0:1789185609.942572:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898370176 00000100:00100000:2.0:1789185609.944057:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789185609.944078:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898370176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185609.944097:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185609.944117:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72e49 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.944148:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72e49 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.944160:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e49 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.944185:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddfa00, rc 0) 00000100:00100000:2.0:1789185609.944279:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898370176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (15212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.944285:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789185609.948046:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185609.948076:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.948090:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185609.948174:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185609.948245:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185609.953273:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d12300 going to sleep for 11 seconds 00000100:00100000:0.0:1789185609.958325:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898370304 00000100:00100000:0.0:1789185609.958344:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898370304 00000100:00100000:0.0:1789185609.958410:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789185609.958419:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898370304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.958622:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898370304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (10376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185609.958630:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789185609.958708:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.959055:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.959105:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.959147:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c31380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185609.959163:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898370432 00000100:00100000:0.0:1789185609.959167:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898370432 00000100:00100000:0.0:1789185609.959189:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789185609.959194:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898370432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.959357:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898370432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185609.959363:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789185609.959406:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.959618:0:10409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10409:1876096898370560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185609.959808:0:10409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.959829:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898370560 00000100:00100000:0.0:1789185609.959833:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898370560 00000100:00100000:0.0:1789185609.959851:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789185609.959858:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:10409:x1876096898370560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185609.959953:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:10409:x1876096898370560:12345-0@lo:502:llog_process_th.0 Request processed in 95us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185609.959960:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789185609.959993:0:10409:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185609.960005:0:10409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10409:1876096898370560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185609.960023:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185609.960032:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185609.960034:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789185609.960042:0:10409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f2d26ca000 00000020:00000080:0.0:1789185609.960044:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789185609.961594:0:10409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10409:1876096898370688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185609.963456:0:10409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.963527:0:10409:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185609.963807:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898370688 00000100:00100000:3.0:1789185609.963816:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898370688 00000100:00100000:3.0:1789185609.963868:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789185609.963878:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:10409:x1876096898370688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185609.965407:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:10409:x1876096898370688:12345-0@lo:502:llog_process_th.0 Request processed in 1525us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.965420:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789185609.965573:0:10409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10409:1876096898370688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185609.965607:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185609.965615:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185609.965617:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789185609.965622:0:10409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789185609.965938:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789185609.965961:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185609.965972:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.965982:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185609.965993:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185609.965996:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f30030e800 from 4 10000000:01000000:2.0:1789185609.965999:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185609.966030:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.966037:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.966046:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.966066:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.966105:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.966141:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185609.966406:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898370816 00000100:00100000:3.0:1789185609.966413:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898370816 00000100:00100000:3.0:1789185609.966457:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789185609.966489:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898370816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185609.966503:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185609.966516:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72e57 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.966539:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72e57 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.966550:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e57 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185609.966561:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166da00, rc 0) 00000100:00100000:3.0:1789185609.966602:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898370816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.966609:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789185609.966743:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185609.966762:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.966772:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.966828:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.966855:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.966874:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185609.966888:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898370944 00000100:00100000:2.0:1789185609.966892:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898370944 00000100:00100000:2.0:1789185609.966939:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789185609.966946:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898370944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.967045:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898370944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.967052:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789185609.967080:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898370944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.967105:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898371072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.967144:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.967157:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185609.967168:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898371072 00000100:00100000:2.0:1789185609.967171:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898371072 00000100:00100000:2.0:1789185609.967188:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789185609.967193:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898371072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.967278:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898371072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.967294:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789185609.967330:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898371072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.967522:0:10410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10410:1876096898371200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185609.967555:0:10410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.967572:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898371200 00000100:00100000:2.0:1789185609.967576:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898371200 00000100:00100000:2.0:1789185609.967591:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789185609.967597:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:10410:x1876096898371200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185609.967669:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:10410:x1876096898371200:12345-0@lo:502:llog_process_th.0 Request processed in 71us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.967676:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789185609.967700:0:10410:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c19090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185609.967712:0:10410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10410:1876096898371200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185609.967730:0:10410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185609.967738:0:10410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185609.967740:0:10410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789185609.967746:0:10410:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f30030e800 00000020:00000080:2.0:1789185609.967749:0:10410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789185609.967813:0:10410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10410:1876096898371328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185609.967843:0:10410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.967860:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898371328 00000100:00100000:2.0:1789185609.967864:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898371328 00000100:00100000:2.0:1789185609.967880:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789185609.967886:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:10410:x1876096898371328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185609.967960:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:10410:x1876096898371328:12345-0@lo:502:llog_process_th.0 Request processed in 74us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.967973:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789185609.967997:0:10410:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c19090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185609.968009:0:10410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10410:1876096898371328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185609.968026:0:10410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185609.968031:0:10410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185609.968032:0:10410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789185609.968036:0:10410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789185609.968080:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789185609.968096:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185609.968102:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.968112:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185609.968121:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185609.968124:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2e7ae1000 from 4 10000000:01000000:2.0:1789185609.968126:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185609.968144:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.968153:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.968162:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.968174:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898371456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.968198:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.968216:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c19090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185609.968227:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898371456 00000100:00100000:2.0:1789185609.968231:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898371456 00000100:00100000:2.0:1789185609.968246:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789185609.968251:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898371456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185609.968258:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185609.968268:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72e65 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.968285:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72e65 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.968293:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e65 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.968301:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf600, rc 0) 00000100:00100000:2.0:1789185609.968327:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898371456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.968333:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789185609.968357:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898371456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185609.968368:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.968376:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185609.968411:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898371584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.968432:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.968451:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c19090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185609.968461:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898371584 00000100:00100000:2.0:1789185609.968465:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898371584 00000100:00100000:2.0:1789185609.968498:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789185609.968504:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898371584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.968571:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898371584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.968579:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789185609.968605:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898371584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.968627:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898371712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.968657:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185609.968669:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3451d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185609.968679:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898371712 00000100:00100000:2.0:1789185609.968682:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898371712 00000100:00100000:2.0:1789185609.968697:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789185609.968702:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898371712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185609.968760:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898371712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185609.968766:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789185609.968798:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898371712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185609.978403:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10411:1876096898371840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185609.978512:0:10411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.980445:0:10411:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185609.985823:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898371840 00000100:00100000:3.0:1789185609.985839:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898371840 00000100:00100000:3.0:1789185609.985926:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789185609.985937:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:10411:x1876096898371840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185609.986108:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:10411:x1876096898371840:12345-0@lo:502:llog_process_th.0 Request processed in 172us (7595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.986116:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789185609.989075:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10411:1876096898371840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185609.989119:0:10411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185609.989131:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185609.989134:0:10411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789185609.989142:0:10411:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f2e7ae1000 00000020:00000080:0.0:1789185609.989145:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789185609.989246:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10411:1876096898371968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185609.989316:0:10411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185609.989356:0:10411:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185609.990351:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898371968 00000100:00100000:3.0:1789185609.990361:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898371968 00000100:00100000:3.0:1789185609.990419:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789185609.990428:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:10411:x1876096898371968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185609.990580:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:10411:x1876096898371968:12345-0@lo:502:llog_process_th.0 Request processed in 152us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185609.990592:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789185609.991066:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:10411:1876096898371968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185609.991093:0:10411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185609.991100:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185609.991102:0:10411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789185609.991107:0:10411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789185609.991390:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789185609.991411:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185609.991421:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185609.991433:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185610.023652:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185610.150147:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898372096:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150214:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150263:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898372608:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150283:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150303:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898373120:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150320:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150343:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789185610.150348:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898372224:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150368:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150384:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898372736:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150402:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150419:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898373248:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150436:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150463:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898372352:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150499:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150510:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898372864:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150544:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150566:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898373376:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150586:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150609:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789185610.150614:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898372480:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150633:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150648:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898372992:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150677:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150693:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898373504:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150711:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.150743:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898372096 00000100:00100000:2.0:1789185610.150750:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898372096 00000100:00100000:2.0:1789185610.150786:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898372608 00000100:00100000:2.0:1789185610.150788:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898372608 00000100:00100000:2.0:1789185610.150811:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898373120 00000100:00100000:2.0:1789185610.150814:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898373120 00000100:00100000:2.0:1789185610.150825:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898372736 00000100:00100000:2.0:1789185610.150827:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898372736 00000100:00100000:2.0:1789185610.150837:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898373248 00000100:00100000:2.0:1789185610.150839:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898373248 00000100:00100000:2.0:1789185610.150848:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898372352 00000100:00100000:2.0:1789185610.150850:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898372352 00000100:00100000:2.0:1789185610.150862:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789185610.150871:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898372096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150943:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898372096:12345-0@lo:400:kworker.0 Request processed in 73us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.150950:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789185610.150966:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789185610.150972:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898372608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.150996:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898372608:12345-0@lo:400:kworker.0 Request processed in 24us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151001:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789185610.151010:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789185610.151015:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898373120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151037:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898373120:12345-0@lo:400:kworker.0 Request processed in 22us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151049:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789185610.151063:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789185610.151068:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898372736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151094:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898372736:12345-0@lo:400:kworker.0 Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151100:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789185610.151109:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789185610.151115:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898373248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151138:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898373248:12345-0@lo:400:kworker.0 Request processed in 23us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151143:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789185610.151154:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185610.151159:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898372352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151189:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898372352:12345-0@lo:400:kworker.0 Request processed in 29us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151194:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185610.151225:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898372864 00000100:00100000:2.0:1789185610.151229:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898372864 00000100:00100000:2.0:1789185610.151248:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898373376 00000100:00100000:2.0:1789185610.151251:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898373376 00000100:00100000:2.0:1789185610.151259:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898372992 00000100:00100000:2.0:1789185610.151262:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898372992 00000100:00100000:2.0:1789185610.151270:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898373504 00000100:00100000:2.0:1789185610.151272:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898373504 00000100:00100000:2.0:1789185610.151284:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789185610.151289:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898372864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151328:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898372864:12345-0@lo:400:kworker.0 Request processed in 39us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151334:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789185610.151346:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185610.151352:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898373376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151376:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898373376:12345-0@lo:400:kworker.0 Request processed in 25us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151381:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185610.151392:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789185610.151398:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898372992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151423:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898372992:12345-0@lo:400:kworker.0 Request processed in 25us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151428:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789185610.151439:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789185610.151445:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898373504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151485:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898373504:12345-0@lo:400:kworker.0 Request processed in 40us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151491:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789185610.151512:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898372224 00000100:00100000:2.0:1789185610.151516:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898372224 00000100:00100000:2.0:1789185610.151539:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898372480 00000100:00100000:2.0:1789185610.151541:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898372480 00000100:00100000:2.0:1789185610.151554:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789185610.151559:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898372224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151589:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898372224:12345-0@lo:400:kworker.0 Request processed in 30us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151605:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789185610.151617:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789185610.151623:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898372480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151650:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898372480:12345-0@lo:400:kworker.0 Request processed in 27us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.151655:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789185610.151677:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185610.151681:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185610.151683:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185610.151685:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185610.151716:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898372480:0@lo:400:kworker.0 00010000:00080000:2.0:1789185610.151730:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7495f80 x1876096898372992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185610.151741:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898372992:0@lo:400:kworker.0 00010000:00080000:2.0:1789185610.151750:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b7480 x1876096898373504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185610.151759:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898373504:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151769:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898372352:0@lo:400:kworker.0 00010000:00080000:2.0:1789185610.151780:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7497480 x1876096898372864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185610.151788:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898372864:0@lo:400:kworker.0 00010000:00080000:2.0:1789185610.151797:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758d180 x1876096898373376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185610.151815:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898373376:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151854:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898372224:0@lo:400:kworker.0 00010000:00080000:2.0:1789185610.151863:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7494380 x1876096898372736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185610.151870:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898372736:0@lo:400:kworker.0 00010000:00080000:2.0:1789185610.151878:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7495500 x1876096898373248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185610.151885:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898373248:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151894:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898372096:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151901:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898372608:0@lo:400:kworker.0 00000100:00100000:2.0:1789185610.151931:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898373120:0@lo:400:kworker.0 00000100:00100000:1.0:1789185610.152075:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185610.152086:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898373632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185610.152118:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185610.152144:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898373632 00000100:00100000:1.0:1789185610.152148:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898373632 00000100:00100000:1.0:1789185610.152170:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789185610.152177:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898373632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185610.152198:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185610.152230:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898373632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185610.152236:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789185610.152263:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d1180 x1876096898373632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185610.152275:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898373632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185610.153534:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898373760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185610.153578:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185610.153686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898373760 00000100:00100000:2.0:1789185610.153693:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898373760 00000100:00100000:2.0:1789185610.153731:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789185610.153738:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898373760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185610.153764:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185610.153814:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898373760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185610.153820:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789185610.153986:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898373760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185610.157770:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185610.157793:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898373888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185610.157865:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185610.158049:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898373888 00000100:00100000:1.0:1789185610.158058:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898373888 00000100:00100000:1.0:1789185610.158107:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789185610.158115:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898373888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185610.158137:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185610.158181:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898373888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185610.158188:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789185610.158227:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d1180 x1876096898373888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185610.158246:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898373888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185610.984065:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185610.984107:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879434112 00000100:00100000:1.0:1789185610.984119:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879434112 00000100:00100000:1.0:1789185610.984174:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 272 00000100:00100000:1.0:1789185610.984185:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:6163:x1876096879434112:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185610.984202:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185610.984220:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d06 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.984251:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d06 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.984263:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d06 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185610.984273:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9600, rc 0) 00000100:00100000:1.0:1789185610.984346:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6163:x1876096879434112:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 Request processed in 162us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185610.984354:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 272 00000100:00100000:1.0:1789185610.993946:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185610.994030:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879434240 00000100:00100000:3.0:1789185610.994040:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879434240 00000100:00100000:3.0:1789185610.994103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 273 00000100:00100000:3.0:1789185610.994113:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6163:x1876096879434240:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185610.994252:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6163:x1876096879434240:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 Request processed in 141us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185610.994260:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 273 00000100:00100000:3.0:1789185611.000705:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185611.000779:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879434368 00000100:00100000:1.0:1789185611.000789:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879434368 00000100:00100000:1.0:1789185611.000846:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 274 00000100:00100000:1.0:1789185611.000858:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6163:x1876096879434368:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185611.001017:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6163:x1876096879434368:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 Request processed in 161us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185611.001026:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 274 00000100:00100000:3.0:1789185611.004519:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185611.004629:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879434496 00000100:00100000:1.0:1789185611.004639:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879434496 00000100:00100000:1.0:1789185611.004696:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 275 00000100:00100000:1.0:1789185611.004707:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6703:x1876096879434496:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185611.004848:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6703:x1876096879434496:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 142us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185611.004856:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 275 00000100:00100000:2.0:1789185611.018750:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185611.019985:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879434624 00000100:00100000:1.0:1789185611.019995:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879434624 00000100:00100000:1.0:1789185611.020045:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 276 00000100:00100000:1.0:1789185611.020054:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6703:x1876096879434624:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185611.020199:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:6703:x1876096879434624:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 145us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185611.020207:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 276 00010000:00010000:0.0:1789185611.046361:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185611.686096:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898374016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185611.686189:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185611.686416:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898374016 00000100:00100000:1.0:1789185611.686429:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898374016 00000100:00100000:1.0:1789185611.686498:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789185611.686508:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898374016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185611.686546:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185611.686595:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898374016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185611.686603:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789185611.687325:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898374016:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789185612.073171:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185612.711203:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898374144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185612.711275:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185612.711585:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898374144 00000100:00100000:2.0:1789185612.711595:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898374144 00000100:00100000:2.0:1789185612.711664:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789185612.711676:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898374144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185612.711706:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185612.711754:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898374144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185612.711761:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789185612.711896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789185612.711986:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33f8380 x1876096898374144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185612.712006:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898374144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185612.712022:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185612.712031:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898374272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185612.712058:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185612.712129:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898374272 00000100:00100000:1.0:1789185612.712134:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898374272 00000100:00100000:1.0:1789185612.712183:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789185612.712201:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898374272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185612.712213:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185612.712246:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898374272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185612.712253:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789185612.714437:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d1880 x1876096898374272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185612.714463:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898374272:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789185612.715066:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789185613.095222:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185613.166936:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185613.166973:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185613.166995:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185613.167011:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185613.167030:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185613.167054:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879435008 00000100:00100000:0.0:1789185613.167063:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879435008 00000100:00100000:0.0:1789185613.167115:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879434880 00000100:00100000:0.0:1789185613.167117:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879434880 00000100:00100000:0.0:1789185613.167138:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 75 00000100:00100000:0.0:1789185613.167147:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879435008:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185613.167218:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879435008:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185613.167224:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 75 00000100:00100000:0.0:1789185613.167241:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 76 00000100:00100000:0.0:1789185613.167247:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879434880:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185613.167274:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879434880:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185613.167281:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 76 00000100:00100000:0.0:1789185613.167298:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879435264 00000100:00100000:0.0:1789185613.167302:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879435264 00000100:00100000:0.0:1789185613.167325:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879435136 00000100:00100000:0.0:1789185613.167327:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879435136 00000100:00100000:0.0:1789185613.167344:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:0.0:1789185613.167351:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879435264:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185613.167393:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879435264:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 43us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185613.167401:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:0.0:1789185613.167426:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:0.0:1789185613.167433:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879435136:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185613.167456:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879435136:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185613.167462:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00080000:0.0:1789185613.167483:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185613.167488:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185613.167490:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185613.167492:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185613.168345:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879434752 00000100:00100000:3.0:1789185613.168355:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879434752 00000100:00100000:3.0:1789185613.168405:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 277 00000100:00100000:3.0:1789185613.168434:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879434752:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185613.168798:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879434752:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 366us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185613.168807:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 277 00010000:00010000:0.0:1789185614.118098:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185615.143599:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185615.270172:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898374400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185615.270247:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185615.270302:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185615.270309:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898374528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185615.270329:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185615.270396:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898374400 00000100:00100000:2.0:1789185615.270402:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898374400 00000100:00100000:2.0:1789185615.270448:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898374528 00000100:00100000:2.0:1789185615.270451:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898374528 00000100:00100000:2.0:1789185615.270466:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789185615.270475:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898374400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789185615.270502:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185615.270544:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898374400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.270552:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789185615.270576:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789185615.270582:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898374528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185615.270592:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185615.270615:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898374528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.270621:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789185615.270640:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898374656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185615.270666:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789185615.270694:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185615.270709:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898374656 00000100:00100000:2.0:1789185615.270711:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898374656 00000100:00100000:2.0:1789185615.270737:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789185615.270743:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898374656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185615.270770:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789185615.271209:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898374784:0@lo:400:kworker.0 00000100:00100000:1.0:1789185615.273853:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898375168:0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277044:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898374656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6292us (6368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.277059:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789185615.277114:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898375040:0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277158:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185615.277183:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898375552:0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277208:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185615.277234:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789185615.277241:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898374912:0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277260:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185615.277276:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898375424:0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277296:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185615.277320:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898375936:0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277339:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185615.277380:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898375040 00000100:00100000:2.0:1789185615.277388:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898375040 00000100:00100000:2.0:1789185615.277426:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898374912 00000100:00100000:2.0:1789185615.277428:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898374912 00000100:00100000:2.0:1789185615.277439:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898375424 00000100:00100000:2.0:1789185615.277441:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898375424 00000100:00100000:2.0:1789185615.277459:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898375936 00000100:00100000:2.0:1789185615.277461:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898375936 00000100:00100000:2.0:1789185615.277475:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789185615.277482:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898375040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277529:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898375040:12345-0@lo:400:kworker.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.277536:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789185615.277548:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789185615.277554:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898374912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277579:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898374912:12345-0@lo:400:kworker.0 Request processed in 25us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.277584:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789185615.277597:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789185615.277602:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898375424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277625:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898375424:12345-0@lo:400:kworker.0 Request processed in 22us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.277630:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789185615.277640:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789185615.277645:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898375936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277693:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898375936:12345-0@lo:400:kworker.0 Request processed in 48us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.277700:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789185615.277717:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898375552 00000100:00100000:2.0:1789185615.277721:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898375552 00000100:00100000:2.0:1789185615.277745:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789185615.277751:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898375552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.277779:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898375552:12345-0@lo:400:kworker.0 Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.277785:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789185615.277993:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185615.278029:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898375296:0@lo:400:kworker.0 00000100:00100000:0.0:1789185615.278054:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185615.278071:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898375808:0@lo:400:kworker.0 00000100:00100000:0.0:1789185615.278103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185615.278130:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898374784 00000100:00100000:0.0:1789185615.278134:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898374784 00000100:00100000:0.0:1789185615.278163:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789185615.278169:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898374784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185615.278202:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898374784:12345-0@lo:400:kworker.0 Request processed in 34us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185615.278216:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00080000:0.0:1789185615.278267:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7488000 x1876096898374528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185615.278288:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898374528:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789185615.278305:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d3100 x1876096898374400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185615.278316:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898374400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185615.278344:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898374784:0@lo:400:kworker.0 00000100:00100000:1.0:1789185615.278462:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185615.278487:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898375680:0@lo:400:kworker.0 00000100:00100000:1.0:1789185615.278508:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185615.278532:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898374656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185615.278595:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898375680 00000100:00100000:0.0:1789185615.278599:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898375680 00000100:00100000:0.0:1789185615.278632:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789185615.278639:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898375680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185615.278671:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898375680:12345-0@lo:400:kworker.0 Request processed in 33us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185615.278677:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789185615.279038:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7489180 x1876096898375680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185615.279048:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898375680:0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.279544:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898375296 00000100:00100000:2.0:1789185615.279550:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898375296 00000100:00100000:2.0:1789185615.279575:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898375808 00000100:00100000:2.0:1789185615.279578:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898375808 00000100:00100000:2.0:1789185615.279593:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789185615.279600:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898375296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.279657:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898375296:12345-0@lo:400:kworker.0 Request processed in 58us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.279663:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789185615.279677:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789185615.279683:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898375808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185615.279714:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898375808:12345-0@lo:400:kworker.0 Request processed in 31us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.279720:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789185615.279750:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898375168 00000100:00100000:2.0:1789185615.279753:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898375168 00000100:00100000:2.0:1789185615.279777:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789185615.279791:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898375168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185615.280069:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898374912:0@lo:400:kworker.0 00010000:00080000:3.0:1789185615.280083:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f748a680 x1876096898375424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185615.280093:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898375424:0@lo:400:kworker.0 00010000:00080000:3.0:1789185615.280104:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b2d80 x1876096898375936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185615.280105:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898375168:12345-0@lo:400:kworker.0 Request processed in 315us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185615.280112:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789185615.280113:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898375936:0@lo:400:kworker.0 00000100:00100000:3.0:1789185615.280124:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898375040:0@lo:400:kworker.0 00010000:00080000:3.0:1789185615.280134:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7489880 x1876096898375552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185615.280141:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898375552:0@lo:400:kworker.0 00000100:00080000:3.0:1789185615.280170:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185615.280174:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789185615.280176:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185615.280287:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898375168:0@lo:400:kworker.0 00000100:00100000:1.0:1789185615.280318:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898375296:0@lo:400:kworker.0 00000100:00100000:1.0:1789185615.280328:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898375808:0@lo:400:kworker.0 00010000:00010000:0.0:1789185616.166045:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185616.463249:0:10693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1789185616.808394:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898376064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185616.808475:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185616.808585:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898376064 00000100:00100000:2.0:1789185616.808594:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898376064 00000100:00100000:2.0:1789185616.808646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789185616.808656:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898376064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185616.808688:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789185616.811662:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898376064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2998us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185616.811676:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789185616.814443:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898376064:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185617.191030:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185617.831245:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898376192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185617.831343:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185617.831871:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898376192 00000100:00100000:2.0:1789185617.831881:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898376192 00000100:00100000:2.0:1789185617.831976:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789185617.831986:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898376192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185617.832022:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185617.832085:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898376192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185617.832091:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789185617.832132:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33fb100 x1876096898376192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185617.832154:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898376192:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789185617.832221:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185617.832433:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898376320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185617.832468:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185617.832543:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898376320 00000100:00100000:3.0:1789185617.832548:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898376320 00000100:00100000:3.0:1789185617.832598:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789185617.832606:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898376320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185617.832617:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185617.832652:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898376320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185617.832659:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789185617.832683:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d3480 x1876096898376320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185617.832695:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898376320:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789185617.832766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185618.214115:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185618.281643:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185618.281736:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185618.281780:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185618.281804:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185618.281842:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185618.281872:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879435904 00000100:00100000:0.0:1789185618.281882:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879435904 00000100:00100000:0.0:1789185618.281955:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879435776 00000100:00100000:0.0:1789185618.281958:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879435776 00000100:00100000:0.0:1789185618.281980:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:0.0:1789185618.281990:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879435904:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185618.282059:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879435904:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185618.282068:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:0.0:1789185618.282085:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 32 00000100:00100000:0.0:1789185618.282092:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879435776:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185618.282117:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879435776:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185618.282124:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 32 00000100:00080000:0.0:1789185618.282139:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185618.282142:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185618.282524:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879435648 00000100:00100000:2.0:1789185618.282530:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879435648 00000100:00100000:2.0:1789185618.282578:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879435520 00000100:00100000:2.0:1789185618.282581:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879435520 00000100:00100000:2.0:1789185618.282602:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 83 00000100:00100000:2.0:1789185618.282608:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879435648:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185618.282638:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879435648:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 30us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185618.282644:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 83 00000100:00100000:2.0:1789185618.282658:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 84 00000100:00100000:2.0:1789185618.282663:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879435520:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185618.282685:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879435520:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 22us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185618.282691:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 84 00000100:00080000:2.0:1789185618.282719:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185618.282722:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185618.282903:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879435392 00000100:00100000:1.0:1789185618.282928:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879435392 00000100:00100000:1.0:1789185618.282963:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 279 00000100:00100000:1.0:1789185618.282970:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2390:x1876096879435392:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185618.283011:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2390:x1876096879435392:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 42us (3015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185618.283018:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 279 00010000:00010000:3.0:1789185619.239128:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185620.262126:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185620.390460:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185620.390487:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898376448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185620.390566:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185620.390686:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898376576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185620.390714:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185620.390859:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898376576 00000100:00100000:0.0:1789185620.390867:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898376576 00000100:00100000:1.0:1789185620.390870:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898376960:0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.390903:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185620.390939:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898377472:0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.390954:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789185620.390960:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185620.390963:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898376576:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185620.390976:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898377984:0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.390993:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789185620.391002:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185620.391008:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789185620.391013:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898377088:0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.391032:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185620.391049:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898377600:0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.391052:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898376576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185620.391060:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789185620.391081:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185620.391091:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898376704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185620.391098:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898378112:0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.391114:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185620.391116:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185620.391130:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898377216:0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.391139:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898376960 00000100:00100000:0.0:1789185620.391148:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185620.391149:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898376960 00000100:00100000:1.0:1789185620.391176:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898377472 00000100:00100000:1.0:1789185620.391179:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898377472 00000100:00100000:1.0:1789185620.391193:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898377984 00000100:00100000:1.0:1789185620.391195:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898377984 00000100:00100000:1.0:1789185620.391204:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898377088 00000100:00100000:1.0:1789185620.391206:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898377088 00000100:00100000:1.0:1789185620.391218:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789185620.391224:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898376960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.391263:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898376960:12345-0@lo:400:kworker.0 Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185620.391270:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789185620.391296:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789185620.391303:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898377472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.391329:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898377472:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185620.391334:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789185620.391343:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789185620.391349:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898377984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.391371:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898377984:12345-0@lo:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185620.391375:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789185620.391385:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789185620.391390:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898377088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.391414:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898377088:12345-0@lo:400:kworker.0 Request processed in 24us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185620.391419:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789185620.391456:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898377600 00000100:00100000:1.0:1789185620.391460:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898377600 00000100:00100000:1.0:1789185620.391501:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898378112 00000100:00100000:1.0:1789185620.391505:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898378112 00000100:00100000:1.0:1789185620.391524:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789185620.391530:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898377600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.391576:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898377600:12345-0@lo:400:kworker.0 Request processed in 46us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185620.391582:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789185620.391592:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789185620.391598:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f77e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898378112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.391622:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f77e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898378112:12345-0@lo:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185620.391628:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789185620.391771:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898376704 00000100:00100000:1.0:1789185620.391775:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898376704 00000100:00100000:1.0:1789185620.391798:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789185620.391803:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898376704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185620.391812:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185620.391838:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898376704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185620.391844:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789185620.391895:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898377088:0@lo:400:kworker.0 00010000:00080000:1.0:1789185620.391927:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ef800 x1876096898377600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185620.391937:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898377600:0@lo:400:kworker.0 00010000:00080000:1.0:1789185620.391958:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f748b800 x1876096898378112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185620.391966:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898378112:0@lo:400:kworker.0 00000100:00100000:1.0:1789185620.391976:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898376960:0@lo:400:kworker.0 00010000:00080000:1.0:1789185620.391985:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ef100 x1876096898377472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185620.391992:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898377472:0@lo:400:kworker.0 00010000:00080000:1.0:1789185620.392001:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7489f80 x1876096898377984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185620.392009:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898377984:0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.398713:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898377728:0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.398778:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789185620.398838:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36eed80 x1876096898376704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185620.398859:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898376704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185620.398875:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789185620.398893:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898376832:0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.398938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185620.398959:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898377344:0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.398988:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185620.399006:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898377856:0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.399031:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789185620.399064:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185620.399300:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898376448 00000100:00100000:2.0:1789185620.399310:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898376448 00000100:00100000:2.0:1789185620.399357:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898377216 00000100:00100000:2.0:1789185620.399361:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898377216 00000100:00100000:2.0:1789185620.399378:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185620.399387:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898376448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185620.399424:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185620.399470:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898376448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (8905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185620.399477:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185620.399493:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789185620.399499:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898377216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185620.399535:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898377216:12345-0@lo:400:kworker.0 Request processed in 36us (8385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185620.399749:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789185620.399793:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898377216:0@lo:400:kworker.0 00000100:00100000:2.0:1789185620.401388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898376832 00000100:00100000:2.0:1789185620.401401:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898376832 00000100:00100000:2.0:1789185620.401462:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789185620.401472:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898376832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185620.401558:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898376832:12345-0@lo:400:kworker.0 Request processed in 88us (2619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185620.401565:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789185620.401599:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898377728 00000100:00100000:2.0:1789185620.401604:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898377728 00000100:00100000:2.0:1789185620.401638:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789185620.401645:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898377728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185620.401682:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898377728:12345-0@lo:400:kworker.0 Request processed in 39us (2905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185620.401687:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789185620.401737:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33fa300 x1876096898376576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185620.401756:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898376576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185620.401772:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898376448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185620.401804:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898376832:0@lo:400:kworker.0 00010000:00080000:2.0:1789185620.401816:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ec000 x1876096898377728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185620.401825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898377728:0@lo:400:kworker.0 00000100:00080000:0.0:1789185620.402404:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185620.402410:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185620.402413:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185620.402429:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898377344 00000100:00100000:0.0:1789185620.402441:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898377344 00000100:00100000:0.0:1789185620.402484:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898377856 00000100:00100000:0.0:1789185620.402488:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898377856 00000100:00100000:0.0:1789185620.402513:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789185620.402520:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898377344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.402571:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898377344:12345-0@lo:400:kworker.0 Request processed in 51us (3589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185620.402577:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789185620.402592:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789185620.402598:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898377856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185620.402628:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898377856:12345-0@lo:400:kworker.0 Request processed in 31us (3596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185620.402634:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789185620.403781:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898377344:0@lo:400:kworker.0 00000100:00100000:2.0:1789185620.403797:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898377856:0@lo:400:kworker.0 00000100:00080000:2.0:1789185620.403829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789185621.287583:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185621.878464:0:10936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing yml_node 00000100:00100000:3.0:1789185621.928436:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898378240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185621.928518:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185621.928599:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898378240 00000100:00100000:3.0:1789185621.928608:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898378240 00000100:00100000:3.0:1789185621.928670:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789185621.928680:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898378240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185621.928729:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789185621.928785:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898378240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185621.928800:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789185621.929763:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898378240:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789185622.310166:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185622.950679:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185622.950703:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898378368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185622.950779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185622.950876:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898378368 00000100:00100000:1.0:1789185622.950884:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898378368 00000100:00100000:1.0:1789185622.950960:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789185622.950970:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898378368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185622.951003:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185622.951058:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898378368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185622.951065:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789185622.951124:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d0000 x1876096898378368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185622.951161:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898378368:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789185622.951683:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185622.955209:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185622.955242:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898378496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185622.955314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185622.955814:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898378496 00000100:00100000:2.0:1789185622.955824:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898378496 00000100:00100000:2.0:1789185622.955899:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789185622.955931:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898378496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185622.955957:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185622.956013:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898378496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185622.956020:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789185622.956060:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d0000 x1876096898378496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185622.956096:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898378496:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789185622.956269:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789185623.338149:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185623.409464:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185623.409517:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185623.409557:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185623.409748:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879436032 00000100:00100000:1.0:1789185623.409761:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879436032 00000100:00100000:1.0:1789185623.409832:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 281 00000100:00100000:1.0:1789185623.409843:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2389:x1876096879436032:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185623.409957:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2389:x1876096879436032:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 115us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185623.409966:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 281 00000100:00100000:3.0:1789185623.410181:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879436288 00000100:00100000:3.0:1789185623.410187:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879436288 00000100:00100000:3.0:1789185623.410253:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879436160 00000100:00100000:3.0:1789185623.410258:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879436160 00000100:00100000:3.0:1789185623.410282:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 91 00000100:00100000:3.0:1789185623.410291:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879436288:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185623.410336:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879436288:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 47us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185623.410344:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 91 00000100:00100000:3.0:1789185623.410362:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 92 00000100:00100000:3.0:1789185623.410369:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879436160:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185623.410397:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879436160:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 28us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185623.410404:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 92 00000100:00080000:1.0:1789185623.410872:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185623.410878:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185623.411603:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185623.411646:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185623.411820:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879436416 00000100:00100000:1.0:1789185623.411829:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879436416 00000100:00100000:1.0:1789185623.411901:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879436544 00000100:00100000:1.0:1789185623.411905:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879436544 00000100:00100000:1.0:1789185623.411962:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:1.0:1789185623.411971:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2388:x1876096879436416:12345-192.168.204.48@tcp:9:kworker.0 00000020:00000080:1.0:1789185623.412003:0:9819:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72d85 00000100:00080000:1.0:1789185623.412013:0:9819:0:(import.c:65:import_set_state_nolock()) ffff98f1c310e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789185623.412072:0:9819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789185623.412238:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+2:2388:x1876096879436416:12345-192.168.204.48@tcp:9:kworker.0 Request processed in 267us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185623.412247:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:1.0:1789185623.412263:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:1.0:1789185623.412269:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2388:x1876096879436544:12345-192.168.204.48@tcp:9:kworker.0 00000020:00000080:1.0:1789185623.412283:0:9819:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72d8c 00000100:00080000:1.0:1789185623.412304:0:9819:0:(import.c:65:import_set_state_nolock()) ffff98f2ff972800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789185623.412327:0:9819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789185623.412395:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+2:2388:x1876096879436544:12345-192.168.204.48@tcp:9:kworker.0 Request processed in 126us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185623.412401:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 19 00010000:00010000:1.0:1789185623.412424:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185623.412429:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789185623.412987:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789185623.412992:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185624.358163:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185625.383654:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185625.510204:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898378624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185625.510295:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185625.510433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898378624 00000100:00100000:2.0:1789185625.510441:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898378624 00000100:00100000:2.0:1789185625.510493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789185625.510502:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898378624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185625.510537:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185625.510597:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898378624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185625.510603:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789185625.510705:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898378624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185625.510860:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898378880:0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.510897:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185625.510941:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898379392:0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.510965:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185625.510990:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898379904:0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.511013:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185625.511044:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789185625.511050:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898378752:0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.511191:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898379008:0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.511231:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185625.511252:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898379520:0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.511276:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185625.511297:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898380032:0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.511318:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185625.511340:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789185625.511345:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898379136:0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.511367:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185625.511385:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898379648:0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.511404:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185625.511419:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898380160:0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.511666:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185625.511700:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898379136 00000100:00100000:3.0:1789185625.511704:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898379136 00000100:00100000:3.0:1789185625.511736:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789185625.511743:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898379136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.511787:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898379136:12345-0@lo:400:kworker.0 Request processed in 44us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185625.511794:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789185625.511826:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898379136:0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.511867:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898378880 00000100:00100000:3.0:1789185625.511871:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898378880 00000100:00100000:3.0:1789185625.511895:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898379392 00000100:00100000:3.0:1789185625.511897:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898379392 00000100:00100000:3.0:1789185625.511956:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898379904 00000100:00100000:3.0:1789185625.511960:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898379904 00000100:00100000:3.0:1789185625.511972:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898379008 00000100:00100000:3.0:1789185625.512191:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898379008 00000100:00100000:3.0:1789185625.512317:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789185625.512326:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898378880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.512365:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898378880:12345-0@lo:400:kworker.0 Request processed in 42us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185625.512371:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789185625.512384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789185625.512391:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898379392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.512418:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898379392:12345-0@lo:400:kworker.0 Request processed in 29us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185625.512424:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789185625.512567:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185625.512598:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898379264:0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.512622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185625.512632:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898379776:0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.512650:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185625.512669:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898378880:0@lo:400:kworker.0 00010000:00080000:0.0:1789185625.512680:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d9b480 x1876096898379392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185625.512690:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898379392:0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.512719:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898379264 00000100:00100000:0.0:1789185625.512723:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898379264 00000100:00100000:1.0:1789185625.512857:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898380288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185625.512894:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185625.512948:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898379520 00000100:00100000:1.0:1789185625.512952:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898379520 00000100:00100000:1.0:1789185625.512976:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898380032 00000100:00100000:1.0:1789185625.512978:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898380032 00000100:00100000:1.0:1789185625.512989:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898379648 00000100:00100000:1.0:1789185625.512991:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898379648 00000100:00100000:1.0:1789185625.513002:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898380160 00000100:00100000:1.0:1789185625.513005:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898380160 00000100:00100000:1.0:1789185625.513018:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789185625.513024:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898379520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185625.513078:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898379520:12345-0@lo:400:kworker.0 Request processed in 42us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185625.513084:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789185625.513096:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789185625.513102:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898380032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185625.513128:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898380032:12345-0@lo:400:kworker.0 Request processed in 27us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185625.513133:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789185625.513142:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789185625.513160:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898379648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185625.513201:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898379648:12345-0@lo:400:kworker.0 Request processed in 41us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185625.513361:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789185625.513374:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789185625.513380:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898380160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185625.513411:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898380160:12345-0@lo:400:kworker.0 Request processed in 32us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185625.513416:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789185625.513515:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898380288 00000100:00100000:1.0:1789185625.513520:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898380288 00000100:00100000:1.0:1789185625.513546:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789185625.513552:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898380288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185625.513572:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185625.513610:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898380288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185625.513616:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789185625.513643:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d0e00 x1876096898380288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185625.513657:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898380288:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789185625.513681:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d99c00 x1876096898379648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185625.513690:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898379648:0@lo:400:kworker.0 00010000:00080000:1.0:1789185625.513700:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98e00 x1876096898380160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185625.513720:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898380160:0@lo:400:kworker.0 00010000:00080000:1.0:1789185625.513733:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98700 x1876096898379520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185625.513740:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898379520:0@lo:400:kworker.0 00010000:00080000:1.0:1789185625.513749:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d9a680 x1876096898380032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185625.513757:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898380032:0@lo:400:kworker.0 00000100:00100000:1.0:1789185625.513795:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898379776 00000100:00100000:1.0:1789185625.513799:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898379776 00000100:00100000:2.0:1789185625.513929:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898378752 00000100:00100000:2.0:1789185625.513939:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898378752 00000100:00100000:2.0:1789185625.513968:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789185625.513974:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898378752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185625.514010:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898378752:12345-0@lo:400:kworker.0 Request processed in 36us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185625.514015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789185625.514049:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185625.514059:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898380416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185625.514096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185625.514190:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789185625.514201:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898379904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.514244:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898379904:12345-0@lo:400:kworker.0 Request processed in 47us (3231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185625.514394:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789185625.514403:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898379008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.514455:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898379008:12345-0@lo:400:kworker.0 Request processed in 54us (3223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185625.514461:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789185625.514474:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789185625.514480:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898379264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.514507:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898379264:12345-0@lo:400:kworker.0 Request processed in 28us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185625.514513:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789185625.514533:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898380416 00000100:00100000:0.0:1789185625.514537:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898380416 00000100:00100000:0.0:1789185625.514570:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789185625.514576:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898380416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185625.514591:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185625.514622:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898380416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185625.514627:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789185625.514650:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33fa300 x1876096898380416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185625.514663:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898380416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185625.514687:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898378752:0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.514697:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898379264:0@lo:400:kworker.0 00010000:00080000:0.0:1789185625.514708:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98380 x1876096898379904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185625.514715:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898379904:0@lo:400:kworker.0 00000100:00100000:0.0:1789185625.514757:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898379008:0@lo:400:kworker.0 00000100:00080000:0.0:1789185625.514800:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185625.514806:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185625.514809:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185625.514811:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185625.519232:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789185625.519260:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898379776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185625.519376:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898379776:12345-0@lo:400:kworker.0 Request processed in 132us (6723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185625.519384:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789185625.519444:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898379776:0@lo:400:kworker.0 00000100:00100000:3.0:1789185625.519762:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:1.0:1789185626.419829:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789185626.586439:0:11120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00000100:00100000:0.0:1789185627.055382:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185627.055414:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898380544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185627.055508:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185627.055589:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898380544 00000100:00100000:0.0:1789185627.055600:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898380544 00000100:00100000:0.0:1789185627.055657:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789185627.055679:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898380544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185627.055726:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185627.055779:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898380544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185627.055786:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789185627.055858:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898380544:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185627.431961:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185628.070341:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185628.070365:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898380672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185628.070441:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185628.070879:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898380672 00000100:00100000:0.0:1789185628.070887:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898380672 00000100:00100000:0.0:1789185628.070968:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789185628.070984:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898380672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185628.071014:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789185628.071060:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185628.071159:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898380800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185628.071195:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185628.071240:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898380800 00000100:00100000:1.0:1789185628.071244:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898380800 00000100:00100000:0.0:1789185628.071271:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898380672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 290us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185628.071274:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789185628.071279:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185628.071280:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898380800:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789185628.071309:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789185628.071394:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185628.071434:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898380800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185628.071441:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789185628.072010:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33f9c00 x1876096898380800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185628.072030:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898380800:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789185628.072341:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d0e00 x1876096898380672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185628.072355:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898380672:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789185628.454152:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185628.524043:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185628.524266:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879436672 00000100:00100000:3.0:1789185628.524277:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879436672 00000100:00100000:3.0:1789185628.524335:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 283 00000100:00100000:3.0:1789185628.524346:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2392:x1876096879436672:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185628.524448:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2392:x1876096879436672:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 103us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185628.524457:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 283 00000100:00100000:1.0:1789185628.531231:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185628.531367:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879436800 00000100:00100000:0.0:1789185628.531378:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879436800 00000100:00100000:0.0:1789185628.531465:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 99 00000100:00100000:0.0:1789185628.531477:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879436800:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185628.531559:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879436800:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185628.531585:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 99 00000100:00080000:1.0:1789185628.532069:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185628.538795:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185628.538936:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879436928 00000100:00100000:0.0:1789185628.538947:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879436928 00000100:00100000:0.0:1789185628.539024:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 100 00000100:00100000:0.0:1789185628.539035:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879436928:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185628.539135:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879436928:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 100us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185628.539142:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 100 00000100:00080000:3.0:1789185628.542026:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1789185628.589931:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:2.0:1789185628.589942:0:8423:0:(genops.c:885:class_export_put()) final put ffff98f1c310f000/f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:3.0:1789185628.590021:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c310f000/f993ea83-7802-4340-a17e-bffdbb8158b1 for lustre-OST0000 00000020:00000080:3.0:1789185628.590103:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c310e000 for lustre-OST0000 00000001:00100000:0.0:1789185628.591755:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:0.0:1789185628.591763:0:9508:0:(genops.c:885:class_export_put()) final put ffff98f2ff970800/f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:2.0:1789185628.594811:0:497:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2ff970800/f993ea83-7802-4340-a17e-bffdbb8158b1 for lustre-OST0001 00000020:00000080:3.0:1789185628.595080:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2ff972800 for lustre-OST0001 00000001:02000400:3.0:1789185629.329337:0:11217:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00010000:00010000:3.0:1789185629.478757:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185630.509166:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185630.630240:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185630.630279:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898381312:0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.630352:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898381184:0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.630391:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185630.630540:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898381312 00000100:00100000:2.0:1789185630.630549:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898381312 00000100:00100000:1.0:1789185630.630549:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898381440:0@lo:400:kworker.0 00000100:00100000:2.0:1789185630.630625:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789185630.630636:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898381312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.633137:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898380928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185630.633217:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185630.633278:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898381824:0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.633308:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185630.633331:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898382336:0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.633352:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185630.633398:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898380928 00000100:00100000:0.0:1789185630.633407:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898380928 00000100:00100000:0.0:1789185630.633483:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789185630.633494:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898380928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185630.633536:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185630.633607:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898380928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185630.633614:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789185630.633642:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898381824 00000100:00100000:0.0:1789185630.633646:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898381824 00000100:00100000:0.0:1789185630.633674:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898382336 00000100:00100000:0.0:1789185630.633677:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898382336 00000100:00100000:0.0:1789185630.633696:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789185630.633702:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898381824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.633740:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898381824:12345-0@lo:400:kworker.0 Request processed in 38us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185630.633746:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789185630.633757:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789185630.633763:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898382336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.633789:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898382336:12345-0@lo:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185630.633795:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:0.0:1789185630.633947:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7488a80 x1876096898381824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185630.633963:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898381824:0@lo:400:kworker.0 00010000:00080000:0.0:1789185630.633975:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ee300 x1876096898382336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185630.633983:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898382336:0@lo:400:kworker.0 00010000:00080000:0.0:1789185630.633993:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98380 x1876096898380928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185630.634020:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898380928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185630.634740:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789185630.634800:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185630.634807:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185630.634829:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898381184 00000100:00100000:3.0:1789185630.634838:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898381184 00000100:00100000:3.0:1789185630.634896:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789185630.634921:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898381184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.634992:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898381184:12345-0@lo:400:kworker.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185630.635000:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789185630.635063:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898381184:0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.635088:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898381696:0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.635123:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185630.635157:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898382208:0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.635186:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185630.635187:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898381696 00000100:00100000:0.0:1789185630.635197:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898381696 00000100:00100000:3.0:1789185630.635242:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898382208 00000100:00100000:3.0:1789185630.635249:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898382208 00000100:00100000:0.0:1789185630.635266:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789185630.635281:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898381696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.635301:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789185630.635315:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898382208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.635352:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898381696:12345-0@lo:400:kworker.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185630.635361:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789185630.637688:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898382208:12345-0@lo:400:kworker.0 Request processed in 2365us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185630.637704:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1789185630.637749:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185630.637813:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898382208:0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.637852:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898382720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185630.637903:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185630.637945:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898381056:0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.637982:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898382720 00000100:00100000:3.0:1789185630.637990:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898382720 00000100:00100000:0.0:1789185630.638027:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185630.638034:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789185630.638046:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898382720:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185630.638095:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898381568:0@lo:400:kworker.0 00000004:00000024:3.0:1789185630.638100:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789185630.638134:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185630.638162:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898382080:0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.638172:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898382720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185630.638181:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789185630.638199:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898381568 00000100:00100000:3.0:1789185630.638204:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898381568 00000100:00100000:0.0:1789185630.638210:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185630.638229:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789185630.638241:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898381568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.638251:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898382592:0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.638298:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898381568:12345-0@lo:400:kworker.0 Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185630.638308:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185630.638320:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789185630.638373:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898381568:0@lo:400:kworker.0 00000100:00100000:3.0:1789185630.638387:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898382720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185630.638419:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898382848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185630.638432:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898381696:0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.638462:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185630.638525:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898382848 00000100:00100000:3.0:1789185630.638531:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898382848 00000100:00100000:3.0:1789185630.641029:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789185630.641045:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898382848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789185630.641091:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185630.641201:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898382848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 158us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185630.641213:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789185630.641262:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789185630.641294:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98380 x1876096898382848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185630.641320:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898382848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185630.641880:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898382080 00000100:00100000:1.0:1789185630.641894:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898382080 00000100:00100000:0.0:1789185630.641922:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898382592 00000100:00100000:0.0:1789185630.641927:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898382592 00000100:00100000:1.0:1789185630.641997:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789185630.642016:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898382080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185630.642118:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898382080:12345-0@lo:400:kworker.0 Request processed in 108us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185630.642126:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789185630.645051:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185630.645301:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898381312:0@lo:400:kworker.0 00000100:00100000:2.0:1789185630.645361:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898381312:12345-0@lo:400:kworker.0 Request processed in 14722us (14968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185630.645376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789185630.645421:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898381056 00000100:00100000:2.0:1789185630.645454:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898381056 00000100:00100000:2.0:1789185630.645562:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789185630.645577:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898381056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185630.645631:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898381056:12345-0@lo:400:kworker.0 Request processed in 62us (7608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185630.645638:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789185630.647885:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185630.647936:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898382592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.648102:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898382592:12345-0@lo:400:kworker.0 Request processed in 200us (9800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185630.648112:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789185630.648125:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898381056:0@lo:400:kworker.0 00010000:00080000:1.0:1789185630.648153:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33edf80 x1876096898382080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185630.648167:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898382080:0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.648174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789185630.648187:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33eca80 x1876096898382592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185630.648197:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898382592:0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.648222:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898381440 00000100:00100000:0.0:1789185630.648231:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898381440 00000100:00100000:0.0:1789185630.648277:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789185630.648285:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898381440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.648327:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898381440:12345-0@lo:400:kworker.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185630.648333:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789185630.648382:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898381440:0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.648399:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898381952:0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.648437:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185630.648464:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898382464:0@lo:400:kworker.0 00000100:00100000:0.0:1789185630.648488:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185630.648534:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898381952 00000100:00100000:1.0:1789185630.648540:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898381952 00000100:00100000:3.0:1789185630.648580:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898382464 00000100:00100000:3.0:1789185630.648596:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898382464 00000100:00100000:1.0:1789185630.648610:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789185630.648621:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898381952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185630.648672:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898381952:12345-0@lo:400:kworker.0 Request processed in 52us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185630.648728:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185630.648739:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898382464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185630.648753:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789185630.648830:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898382464:12345-0@lo:400:kworker.0 Request processed in 92us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185630.648837:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789185630.649053:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185630.649095:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33edc00 x1876096898381952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185630.649107:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898381952:0@lo:400:kworker.0 00010000:00080000:0.0:1789185630.649119:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ef800 x1876096898382464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185630.649127:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898382464:0@lo:400:kworker.0 00010000:00010000:1.0:1789185631.526193:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789185632.003563:0:11315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00000100:00100000:3.0:1789185632.167653:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185632.167688:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898382976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185632.167790:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185632.167944:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898382976 00000100:00100000:0.0:1789185632.167973:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898382976 00000100:00100000:0.0:1789185632.168036:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789185632.168057:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898382976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185632.168104:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185632.168172:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898382976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185632.168180:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789185632.168234:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898382976:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789185632.550222:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185633.190549:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898383104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185633.190654:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185633.190940:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898383232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185633.190976:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185633.191285:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898383104 00000100:00100000:1.0:1789185633.191295:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898383104 00000100:00100000:1.0:1789185633.191361:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898383232 00000100:00100000:1.0:1789185633.191364:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898383232 00000100:00100000:1.0:1789185633.191382:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789185633.191392:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898383104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185633.191431:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185633.191485:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898383104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185633.191493:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789185633.191517:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789185633.191535:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898383232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185633.191546:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185633.191572:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898383232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185633.191577:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789185633.192125:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185633.192171:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d0a80 x1876096898383232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185633.192196:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898383232:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789185633.192236:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33fa300 x1876096898383104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185633.192248:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898383104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185633.583128:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185633.643474:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185633.643526:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185633.643567:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185633.643609:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879437312 00000100:00100000:0.0:1789185633.643624:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879437312 00000100:00100000:0.0:1789185633.643725:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879437184 00000100:00100000:0.0:1789185633.643730:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879437184 00000100:00100000:0.0:1789185633.643762:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 107 00000100:00100000:0.0:1789185633.643775:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879437312:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185633.643884:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879437312:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 111us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185633.643891:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 107 00000100:00100000:0.0:1789185633.643942:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 108 00000100:00100000:0.0:1789185633.643949:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879437184:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185633.643977:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879437184:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185633.643983:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 108 00000100:00080000:0.0:1789185633.644002:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185633.644007:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185633.644463:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879437056 00000100:00100000:2.0:1789185633.644471:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879437056 00000100:00100000:2.0:1789185633.644511:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 285 00000100:00100000:2.0:1789185633.644518:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879437056:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185633.644553:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879437056:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 35us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185633.644560:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 285 00000001:02000400:2.0:1789185633.735691:0:11363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 12 00:00:32 EDT 2026 00010000:00010000:1.0:1789185634.598190:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185635.627718:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185635.751953:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898383488:0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.752079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185635.752147:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898384000:0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.752600:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898383360:0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.752645:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185635.752677:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898383872:0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.752726:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185635.752749:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898384384:0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.752776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185635.752799:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898384896:0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.752821:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185635.752852:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185635.752858:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898385024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185635.752885:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185635.752949:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898383616:0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.752979:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185635.753015:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898384128:0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.753049:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898383744:0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.753119:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898384384 00000100:00100000:0.0:1789185635.753129:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898384384 00000100:00100000:0.0:1789185635.753201:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898384896 00000100:00100000:0.0:1789185635.753204:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898384896 00000100:00100000:0.0:1789185635.753227:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789185635.753237:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898384384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.753298:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898384384:12345-0@lo:400:kworker.0 Request processed in 62us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.753305:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789185635.753325:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789185635.753330:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898384896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.753358:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898384896:12345-0@lo:400:kworker.0 Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.753364:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789185635.753388:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898385024 00000100:00100000:0.0:1789185635.753392:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898385024 00000100:00100000:0.0:1789185635.753421:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185635.753427:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898385024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789185635.753458:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185635.753494:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898385024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.753500:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185635.753527:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898383872 00000100:00100000:0.0:1789185635.753531:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898383872 00000100:00100000:0.0:1789185635.753556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898383616 00000100:00100000:0.0:1789185635.753559:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898383616 00000100:00100000:0.0:1789185635.753572:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789185635.753577:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898383872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.753612:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898383872:12345-0@lo:400:kworker.0 Request processed in 34us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.753617:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789185635.753627:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789185635.753632:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898383616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185635.753657:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898383616:12345-0@lo:400:kworker.0 Request processed in 25us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185635.753662:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1789185635.753679:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185635.753684:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185635.753787:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7488a80 x1876096898385024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185635.753810:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898385024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185635.753825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898383872:0@lo:400:kworker.0 00010000:00080000:0.0:1789185635.753837:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c37ad500 x1876096898384384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185635.753846:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898384384:0@lo:400:kworker.0 00010000:00080000:0.0:1789185635.753857:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c37ac000 x1876096898384896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185635.753864:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898384896:0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.755748:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898383360 00000100:00100000:2.0:1789185635.755761:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898383360 00000100:00100000:2.0:1789185635.755823:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789185635.755834:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898383360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.755963:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898383360:12345-0@lo:400:kworker.0 Request processed in 131us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.755971:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789185635.756076:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898383360:0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.757261:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898383488 00000100:00100000:2.0:1789185635.757274:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898383488 00000100:00100000:2.0:1789185635.757338:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789185635.757349:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898383488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.757445:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898383488:12345-0@lo:400:kworker.0 Request processed in 98us (5366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.757453:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789185635.760185:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185635.760287:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185635.760326:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898384640:0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.760403:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185635.760440:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898385152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185635.760471:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185635.760521:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898383616:0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.760545:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185635.760552:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898385280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185635.760579:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185635.761060:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898384000 00000100:00100000:2.0:1789185635.761070:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898384000 00000100:00100000:2.0:1789185635.761140:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898384128 00000100:00100000:2.0:1789185635.761144:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898384128 00000100:00100000:2.0:1789185635.761165:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898384640 00000100:00100000:2.0:1789185635.761168:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898384640 00000100:00100000:2.0:1789185635.761187:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789185635.761198:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898384000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.761268:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898384000:12345-0@lo:400:kworker.0 Request processed in 71us (9097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.761276:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789185635.761298:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789185635.761305:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898384128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.761349:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898384128:12345-0@lo:400:kworker.0 Request processed in 45us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.761356:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789185635.761368:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789185635.761374:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898384640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.761426:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898384640:12345-0@lo:400:kworker.0 Request processed in 52us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.761433:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1789185635.761454:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185635.761458:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185635.763158:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898385280 00000100:00100000:2.0:1789185635.763182:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898385280 00000100:00100000:2.0:1789185635.763240:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789185635.763250:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898385280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185635.763294:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185635.763379:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898385280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.763386:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789185635.763417:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185635.763462:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898384256:0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.763503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185635.763529:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898384768:0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.763551:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185635.763591:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898384256 00000100:00100000:2.0:1789185635.763595:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898384256 00000100:00100000:2.0:1789185635.763635:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898384768 00000100:00100000:2.0:1789185635.763639:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898384768 00000100:00100000:3.0:1789185635.764101:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898383744 00000100:00100000:3.0:1789185635.764107:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898383744 00000100:00100000:3.0:1789185635.764147:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789185635.764157:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898383744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.764210:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898383744:12345-0@lo:400:kworker.0 Request processed in 55us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.764217:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789185635.764244:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898385152 00000100:00100000:3.0:1789185635.764249:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898385152 00000100:00100000:3.0:1789185635.764275:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789185635.764281:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898385152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185635.764298:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185635.764330:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898385152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (3858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.764346:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789185635.764407:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898385280:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1789185635.764425:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e2300 x1876096898385152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185635.764440:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898385152:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789185635.764456:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b2d80 x1876096898384128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185635.764465:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898384128:0@lo:400:kworker.0 00010000:00080000:3.0:1789185635.764477:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c37af100 x1876096898384640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185635.764485:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898384640:0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.764535:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898383744:0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.764594:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898384000:0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.764603:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898384512:0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.764633:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185635.766107:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185635.766126:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898384256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.767186:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898383488:0@lo:400:kworker.0 00000100:00100000:3.0:1789185635.767271:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789185635.767286:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898384768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.768221:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898384256:12345-0@lo:400:kworker.0 Request processed in 2093us (4708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.768238:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789185635.768312:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b1c00 x1876096898384256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185635.768325:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898384256:0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.768357:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898384512 00000100:00100000:2.0:1789185635.768365:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898384512 00000100:00100000:2.0:1789185635.768415:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789185635.768435:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898384512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185635.768495:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898384512:12345-0@lo:400:kworker.0 Request processed in 62us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185635.768502:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789185635.769826:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898384768:12345-0@lo:400:kworker.0 Request processed in 2537us (6265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185635.769841:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1789185635.769898:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185635.769923:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185635.769964:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898384512:0@lo:400:kworker.0 00010000:00080000:2.0:1789185635.773064:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c37af800 x1876096898384768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185635.773106:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898384768:0@lo:400:kworker.0 00010000:00010000:1.0:1789185636.648168:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185637.288149:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185637.288186:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898385408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185637.288299:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185637.288463:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898385408 00000100:00100000:0.0:1789185637.288475:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898385408 00000100:00100000:0.0:1789185637.288539:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789185637.288552:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898385408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185637.288597:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185637.288655:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898385408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185637.288663:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789185637.288757:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898385408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185637.674274:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185638.310413:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898385536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185638.310530:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185638.310770:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898385536 00000100:00100000:1.0:1789185638.310781:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898385536 00000100:00100000:1.0:1789185638.310883:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789185638.310896:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898385536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185638.310978:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185638.311039:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898385536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185638.311047:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1789185638.311091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789185638.311317:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d3100 x1876096898385536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185638.311339:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898385536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185638.311743:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185638.311760:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898385664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185638.311829:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185638.312049:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898385664 00000100:00100000:1.0:1789185638.312056:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898385664 00000100:00100000:1.0:1789185638.312191:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185638.312204:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898385664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185638.312224:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185638.312275:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898385664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185638.312282:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789185638.312350:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185638.312380:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33f8700 x1876096898385664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185638.312399:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898385664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185638.694441:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185638.759036:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185638.759083:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185638.759172:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185638.759202:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879437568 00000100:00100000:3.0:1789185638.759212:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879437568 00000100:00100000:3.0:1789185638.759271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879437696 00000100:00100000:3.0:1789185638.759275:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879437696 00000100:00100000:3.0:1789185638.759301:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 115 00000100:00100000:3.0:1789185638.759312:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879437568:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185638.759389:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879437568:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 80us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185638.759397:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 115 00000100:00100000:3.0:1789185638.759414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 116 00000100:00100000:3.0:1789185638.759420:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879437696:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185638.759456:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879437696:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 36us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185638.759463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 116 00000100:00080000:3.0:1789185638.759478:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185638.759483:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185638.763068:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879437440 00000100:00100000:2.0:1789185638.763085:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879437440 00000100:00100000:3.0:1789185638.764342:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 287 00000100:00100000:3.0:1789185638.764357:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2389:x1876096879437440:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185638.764464:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2389:x1876096879437440:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 109us (5379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185638.764472:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 287 00010000:00010000:1.0:1789185639.718561:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185640.742164:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185640.871081:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898385792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185640.871173:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.871288:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898385792 00000100:00100000:3.0:1789185640.871296:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898385792 00000100:00100000:3.0:1789185640.871348:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789185640.871357:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898385792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789185640.871385:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185640.871425:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898385792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.871431:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789185640.871454:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898385920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185640.871481:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789185640.871511:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185640.871525:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898385920 00000100:00100000:3.0:1789185640.871528:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898385920 00000100:00100000:3.0:1789185640.871564:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789185640.871569:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898385920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185640.871591:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789185640.871624:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898385920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.871629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789185640.871666:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898385920:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1789185640.871691:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e1180 x1876096898385792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185640.871704:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898385792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185640.872221:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898386048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185640.872255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185640.872332:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898386048 00000100:00100000:0.0:1789185640.872338:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898386048 00000100:00100000:0.0:1789185640.872382:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789185640.872390:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898386048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185640.872407:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185640.872443:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898386048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185640.872451:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789185640.872501:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789185640.872521:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e2a00 x1876096898386048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185640.872536:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898386048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185640.873379:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898386176:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873420:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.873454:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898386688:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873475:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.873490:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898387200:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873506:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.873521:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789185640.873525:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898386304:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873555:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.873569:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898386816:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873584:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.873595:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898387328:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873610:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.873634:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898386688 00000100:00100000:3.0:1789185640.873638:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898386688 00000100:00100000:3.0:1789185640.873669:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898387200 00000100:00100000:3.0:1789185640.873671:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898387200 00000100:00100000:3.0:1789185640.873681:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898386304 00000100:00100000:3.0:1789185640.873683:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898386304 00000100:00100000:3.0:1789185640.873693:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898386816 00000100:00100000:3.0:1789185640.873695:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898386816 00000100:00100000:3.0:1789185640.873704:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898387328 00000100:00100000:3.0:1789185640.873706:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898387328 00000100:00100000:3.0:1789185640.873716:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789185640.873722:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898386688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873826:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898386688:12345-0@lo:400:kworker.0 Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.873833:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789185640.873847:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789185640.873852:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898387200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873873:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898387200:12345-0@lo:400:kworker.0 Request processed in 21us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.873878:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789185640.873898:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789185640.873904:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898386304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873951:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898386304:12345-0@lo:400:kworker.0 Request processed in 48us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.873957:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789185640.873969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789185640.873974:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898386816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.873995:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898386816:12345-0@lo:400:kworker.0 Request processed in 21us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.874001:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789185640.874010:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789185640.874016:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898387328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.874036:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898387328:12345-0@lo:400:kworker.0 Request processed in 21us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.874041:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1789185640.874063:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185640.874066:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185640.874075:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898386432:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.874096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.874110:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898386944:0@lo:400:kworker.0 00000100:00100000:0.0:1789185640.874216:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898386176 00000100:00100000:0.0:1789185640.874220:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898386176 00000100:00100000:0.0:1789185640.874246:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789185640.874257:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898386176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185640.874286:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898386176:12345-0@lo:400:kworker.0 Request processed in 30us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185640.874291:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789185640.874350:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185640.874431:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898386432 00000100:00100000:1.0:1789185640.874435:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898386432 00000100:00100000:1.0:1789185640.874457:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789185640.874462:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898386432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185640.874491:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898386432:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185640.874497:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789185640.874770:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898386432:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.874780:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789185640.874786:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898386560:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.874822:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185640.874847:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898387072:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.874873:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185640.874929:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898386560 00000100:00100000:1.0:1789185640.874937:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898386560 00000100:00100000:1.0:1789185640.874965:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789185640.874970:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898386560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185640.875005:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898386560:12345-0@lo:400:kworker.0 Request processed in 33us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185640.875010:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789185640.885537:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898386304:0@lo:400:kworker.0 00010000:00080000:2.0:1789185640.885561:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e0a80 x1876096898386816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185640.885571:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898386816:0@lo:400:kworker.0 00010000:00080000:2.0:1789185640.885584:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e1180 x1876096898387328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185640.885592:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898387328:0@lo:400:kworker.0 00000100:00100000:2.0:1789185640.885603:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898386176:0@lo:400:kworker.0 00000100:00100000:2.0:1789185640.885613:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898386688:0@lo:400:kworker.0 00000100:00100000:2.0:1789185640.885623:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898387200:0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.890627:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898386560:0@lo:400:kworker.0 00000100:00100000:0.0:1789185640.891156:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898386944 00000100:00100000:0.0:1789185640.891166:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898386944 00000100:00100000:3.0:1789185640.891583:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898387072 00000100:00100000:3.0:1789185640.891588:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898387072 00000100:00100000:3.0:1789185640.891619:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789185640.891628:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898386944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.891720:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898386944:12345-0@lo:400:kworker.0 Request processed in 92us (17370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.891727:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789185640.891761:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789185640.891769:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898387072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185640.891799:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898387072:12345-0@lo:400:kworker.0 Request processed in 31us (16924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185640.891805:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1789185640.891846:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e0700 x1876096898387072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185640.891859:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898387072:0@lo:400:kworker.0 00010000:00080000:3.0:1789185640.891874:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e3480 x1876096898386944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185640.891894:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898386944:0@lo:400:kworker.0 00000100:00080000:0.0:1789185640.892047:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789185641.791436:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185642.411694:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185642.411724:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898387456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185642.411803:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185642.411927:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898387456 00000100:00100000:3.0:1789185642.411936:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898387456 00000100:00100000:3.0:1789185642.412098:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789185642.412109:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898387456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185642.412158:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789185642.412218:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898387456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185642.412225:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789185642.412309:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898387456:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185642.794228:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185643.431138:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185643.431161:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898387584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185643.431237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185643.431318:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898387584 00000100:00100000:2.0:1789185643.431326:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898387584 00000100:00100000:2.0:1789185643.431380:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789185643.431390:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898387584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185643.431417:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185643.431458:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898387584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185643.431464:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789185643.431484:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185643.431513:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33f9180 x1876096898387584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185643.431530:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898387584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185643.446644:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898387712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185643.446720:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185643.446798:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898387712 00000100:00100000:2.0:1789185643.446805:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898387712 00000100:00100000:2.0:1789185643.446885:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789185643.446895:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898387712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185643.446947:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185643.446991:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898387712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185643.446998:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1789185643.447021:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185643.447122:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33f9180 x1876096898387712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185643.447141:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898387712:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789185643.815545:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185643.879813:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185643.879879:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185643.879901:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879437824 00000100:00100000:1.0:1789185643.879962:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185643.879975:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879437824 00000100:00100000:1.0:1789185643.880001:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879438080 00000100:00100000:1.0:1789185643.880013:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879438080 00000100:00100000:3.0:1789185643.880080:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 289 00000100:00100000:1.0:1789185643.880094:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879437952 00000100:00100000:3.0:1789185643.880097:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2392:x1876096879437824:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185643.880101:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879437952 00000100:00100000:1.0:1789185643.880138:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 123 00000100:00100000:1.0:1789185643.880150:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879438080:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185643.880220:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2392:x1876096879437824:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 126us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185643.880237:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 289 00000100:00100000:1.0:1789185643.880239:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879438080:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185643.880251:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 123 00000100:00100000:1.0:1789185643.880274:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 124 00000100:00100000:1.0:1789185643.880282:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879437952:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185643.880319:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879437952:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185643.880344:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 124 00000100:00080000:1.0:1789185643.880378:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185643.880384:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789185644.838179:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185645.862222:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185645.990294:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898387840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185645.990398:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185645.990493:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185645.990501:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898387968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185645.990532:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185645.990573:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898387840 00000100:00100000:2.0:1789185645.990583:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898387840 00000100:00100000:2.0:1789185645.990643:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789185645.990653:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898387840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185645.990698:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185645.990752:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898387840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185645.990760:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789185645.990798:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898387968 00000100:00100000:2.0:1789185645.990802:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898387968 00000100:00100000:2.0:1789185645.990841:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789185645.990848:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898387968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789185645.990872:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185645.990945:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898387968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185645.990952:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1789185645.990974:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789185645.991011:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33f9180 x1876096898387968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185645.991032:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898387968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185645.991074:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898387840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185645.991322:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185645.992365:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898388480:0@lo:400:kworker.0 00000100:00100000:3.0:1789185645.992438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185645.992484:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898388096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185645.992509:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185645.992547:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898388096 00000100:00100000:3.0:1789185645.992554:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898388096 00000100:00100000:3.0:1789185645.992609:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789185645.992618:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898388096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185645.992641:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185645.992688:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898388096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185645.992695:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789185645.992719:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789185645.992753:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d3b80 x1876096898388096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185645.992785:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898388096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185645.992866:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898388480 00000100:00100000:1.0:1789185645.992870:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898388480 00000100:00100000:1.0:1789185645.992929:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789185645.992937:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898388480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.992982:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898388480:12345-0@lo:400:kworker.0 Request processed in 47us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185645.992988:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789185645.993015:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898388480:0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.993169:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898388224:0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.993204:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185645.993240:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185645.993248:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898388352:0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.993272:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185645.993298:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898388352 00000100:00100000:1.0:1789185645.993302:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898388352 00000100:00100000:1.0:1789185645.993328:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789185645.993335:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898388352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.993369:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898388352:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185645.993376:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789185645.993405:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898388352:0@lo:400:kworker.0 00000100:00100000:3.0:1789185645.993469:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898388224 00000100:00100000:3.0:1789185645.993473:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898388224 00000100:00100000:3.0:1789185645.993509:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789185645.993516:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898388224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185645.993552:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898388224:12345-0@lo:400:kworker.0 Request processed in 36us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185645.993558:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789185645.993635:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898388224:0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.993826:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898388736:0@lo:400:kworker.0 00000100:00100000:0.0:1789185645.993828:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898388864:0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.993853:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185645.993877:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898389248:0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.993897:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185645.993946:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898388736 00000100:00100000:1.0:1789185645.993950:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898388736 00000100:00100000:0.0:1789185645.993972:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898389248 00000100:00100000:1.0:1789185645.993975:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789185645.993975:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898389248 00000100:00100000:1.0:1789185645.993982:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898388736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185645.994000:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789185645.994006:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898389248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.994015:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898388736:12345-0@lo:400:kworker.0 Request processed in 34us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185645.994021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789185645.994039:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898389248:12345-0@lo:400:kworker.0 Request processed in 33us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185645.994045:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789185645.994046:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898388736:0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.994055:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898389248:0@lo:400:kworker.0 00000100:00100000:0.0:1789185645.994062:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185645.994070:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898388992:0@lo:400:kworker.0 00000100:00100000:0.0:1789185645.994079:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898389376:0@lo:400:kworker.0 00000100:00100000:0.0:1789185645.994096:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185645.994097:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185645.994112:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789185645.994117:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898388608:0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.994141:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185645.994156:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898389120:0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.994176:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185645.994199:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898388864 00000100:00100000:1.0:1789185645.994202:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898388864 00000100:00100000:1.0:1789185645.994237:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898389376 00000100:00100000:1.0:1789185645.994248:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898389376 00000100:00100000:1.0:1789185645.994272:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789185645.994277:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.994310:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898388864:12345-0@lo:400:kworker.0 Request processed in 33us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185645.994317:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789185645.994328:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789185645.994334:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898389376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185645.994358:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898389376:12345-0@lo:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185645.994364:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:0.0:1789185645.994429:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e2a00 x1876096898388864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185645.994440:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898388864:0@lo:400:kworker.0 00010000:00080000:0.0:1789185645.994450:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e0a80 x1876096898389376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185645.994458:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898389376:0@lo:400:kworker.0 00000100:00100000:3.0:1789185645.994572:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898388992 00000100:00100000:3.0:1789185645.994576:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898388992 00000100:00100000:3.0:1789185645.994756:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898389120 00000100:00100000:3.0:1789185645.994760:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898389120 00000100:00100000:0.0:1789185645.994840:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185645.994849:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898388992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185645.994897:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898388992:12345-0@lo:400:kworker.0 Request processed in 49us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185645.994903:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185645.994943:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185645.994949:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898389120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185645.994977:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898389120:12345-0@lo:400:kworker.0 Request processed in 29us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185645.994982:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789185645.995075:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e1500 x1876096898389120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185645.995085:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898389120:0@lo:400:kworker.0 00010000:00080000:1.0:1789185645.995095:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e0000 x1876096898388992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185645.995103:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898388992:0@lo:400:kworker.0 00000100:00100000:3.0:1789185645.995233:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898388608 00000100:00100000:3.0:1789185645.995238:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898388608 00000100:00100000:3.0:1789185645.995301:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789185645.995309:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898388608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185645.995364:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898388608:12345-0@lo:400:kworker.0 Request processed in 56us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185645.995371:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789185645.995419:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898388608:0@lo:400:kworker.0 00000100:00080000:3.0:1789185645.995497:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789185645.995503:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185645.995506:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185646.887848:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185647.527140:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898389504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185647.527243:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185647.527427:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898389504 00000100:00100000:1.0:1789185647.527437:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898389504 00000100:00100000:1.0:1789185647.527512:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789185647.527528:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898389504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185647.527588:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185647.527708:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898389504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185647.527736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789185647.528859:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898389504:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789185647.910456:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185648.550326:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898389632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185648.550433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185648.550534:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898389632 00000100:00100000:2.0:1789185648.550545:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898389632 00000100:00100000:2.0:1789185648.550636:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789185648.550650:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898389632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185648.550691:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185648.550771:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898389632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185648.550786:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1789185648.550939:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185648.550969:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758df80 x1876096898389632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185648.550997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898389632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185648.551219:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898389760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185648.551273:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185648.551325:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898389760 00000100:00100000:3.0:1789185648.551332:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898389760 00000100:00080000:0.0:1789185648.551364:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185648.551379:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789185648.551389:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898389760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185648.551402:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185648.558071:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898389760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6667us (6780us total) trans 0 rc 0/0 00010000:00080000:1.0:1789185648.558086:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e0700 x1876096898389760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185648.558096:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789185648.558127:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898389760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185648.934891:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185648.999133:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185648.999190:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185648.999253:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185648.999320:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879438208 00000100:00100000:1.0:1789185648.999336:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879438208 00000100:00100000:1.0:1789185648.999418:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 291 00000100:00100000:1.0:1789185648.999431:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2389:x1876096879438208:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185648.999531:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2389:x1876096879438208:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 104us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185648.999539:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 291 00000100:00100000:0.0:1789185649.005579:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879438464 00000100:00100000:0.0:1789185649.005606:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879438464 00000100:00100000:0.0:1789185649.005745:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879438336 00000100:00100000:0.0:1789185649.005750:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879438336 00000100:00100000:1.0:1789185649.005927:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 131 00000100:00100000:1.0:1789185649.005944:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879438464:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185649.006068:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879438464:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 129us (6878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185649.006076:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 131 00000100:00100000:0.0:1789185649.006298:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 132 00000100:00100000:0.0:1789185649.006308:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879438336:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185649.006343:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879438336:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 38us (7090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185649.006349:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 132 00000100:00080000:3.0:1789185649.006679:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185649.006685:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789185649.962101:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789185650.124143:0:11992:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:00:48 (1789185648) === 00000100:00100000:3.0:1789185650.566649:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185650.567161:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879438592 00000100:00100000:1.0:1789185650.567177:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879438592 00000100:00100000:1.0:1789185650.567264:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 292 00000100:00100000:1.0:1789185650.567276:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:8713:x1876096879438592:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789185650.567303:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185650.567330:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf9200/0xda5c730d5a72e7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d0d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185650.567370:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf9200/0xda5c730d5a72e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d0d expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185650.567383:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf9200/0xda5c730d5a72e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d0d expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185650.567394:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9200, rc 0) 00000100:00100000:1.0:1789185650.571539:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8713:x1876096879438592:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 4245us (4884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185650.571558:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 292 00000100:00100000:0.0:1789185650.592627:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185650.593258:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879438720 00000100:00100000:3.0:1789185650.593273:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879438720 00000100:00100000:3.0:1789185650.593357:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 293 00000100:00100000:3.0:1789185650.593370:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8713:x1876096879438720:12345-192.168.204.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789185650.593612:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8713:x1876096879438720:12345-192.168.204.48@tcp:501:mount.lustre.0 Request processed in 244us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185650.593622:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 293 00000100:00100000:2.0:1789185650.607656:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185650.608623:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879438848 00000100:00100000:1.0:1789185650.608640:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879438848 00000100:00100000:1.0:1789185650.608721:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 294 00000100:00100000:1.0:1789185650.608733:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8713:x1876096879438848:12345-192.168.204.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789185650.608875:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8713:x1876096879438848:12345-192.168.204.48@tcp:503:mount.lustre.0 Request processed in 145us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185650.608883:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 294 00000100:00100000:1.0:1789185650.615128:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.619748:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879438976 00000100:00100000:0.0:1789185650.619765:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879438976 00000100:00100000:0.0:1789185650.619831:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 295 00000100:00100000:0.0:1789185650.619856:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8717:x1876096879438976:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185650.620053:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8717:x1876096879438976:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 197us (4934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.620061:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 295 00000100:00100000:0.0:1789185650.668043:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185650.668341:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879439104 00000100:00100000:3.0:1789185650.668356:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879439104 00000100:00100000:3.0:1789185650.668456:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 296 00000100:00100000:3.0:1789185650.668469:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8717:x1876096879439104:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789185650.668688:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8717:x1876096879439104:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 221us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185650.668723:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 296 00000100:00100000:2.0:1789185650.673316:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185650.676254:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879439232 00000100:00100000:1.0:1789185650.676289:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879439232 00000100:00100000:1.0:1789185650.677195:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 297 00000100:00100000:1.0:1789185650.677211:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8717:x1876096879439232:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185650.677387:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8717:x1876096879439232:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 181us (4090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185650.677395:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 297 00000100:00100000:1.0:1789185650.686074:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.686202:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879439360 00000100:00100000:0.0:1789185650.686213:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879439360 00000100:00100000:0.0:1789185650.686273:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 298 00000100:00100000:0.0:1789185650.686283:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:8713:x1876096879439360:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789185650.686313:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185650.686332:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0030200/0xda5c730d5a72e81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d3e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185650.686363:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0030200/0xda5c730d5a72e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d3e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185650.686374:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0030200/0xda5c730d5a72e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d3e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185650.686383:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0030200, rc 0) 00000100:00100000:0.0:1789185650.686453:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:8713:x1876096879439360:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 172us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.686461:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 298 00000100:00100000:2.0:1789185650.689846:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185650.690025:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879439488 00000100:00100000:1.0:1789185650.690041:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879439488 00000100:00100000:1.0:1789185650.690110:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 299 00000100:00100000:1.0:1789185650.690122:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:8713:x1876096879439488:12345-192.168.204.48@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789185650.690157:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789185650.690189:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789185650.690195:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789185650.690198:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789185650.690202:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789185650.690204:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789185650.694266:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:8713:x1876096879439488:12345-192.168.204.48@tcp:256:mount.lustre.0 Request processed in 4124us (4414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185650.694292:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 299 00000100:00100000:3.0:1789185650.704285:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.704811:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879439616 00000100:00100000:0.0:1789185650.704826:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879439616 00000100:00100000:0.0:1789185650.705016:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 300 00000100:00100000:0.0:1789185650.705031:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:8713:x1876096879439616:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789185650.705078:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185650.705104:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d45 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185650.705143:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d45 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185650.705156:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d45 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185650.705167:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0030800, rc 0) 00000100:00100000:0.0:1789185650.705247:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:8713:x1876096879439616:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 220us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.705255:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 300 00000100:00100000:3.0:1789185650.708253:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.708343:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879439744 00000100:00100000:0.0:1789185650.708355:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879439744 00000100:00100000:1.0:1789185650.708495:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 301 00000100:00100000:1.0:1789185650.708510:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:8713:x1876096879439744:12345-192.168.204.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789185650.709011:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:8713:x1876096879439744:12345-192.168.204.48@tcp:501:mount.lustre.0 Request processed in 502us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185650.709021:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 301 00000100:00100000:3.0:1789185650.711354:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.711518:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879439872 00000100:00100000:0.0:1789185650.711532:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879439872 00000100:00100000:0.0:1789185650.711656:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 302 00000100:00100000:0.0:1789185650.711668:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:8713:x1876096879439872:12345-192.168.204.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789185650.711937:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:8713:x1876096879439872:12345-192.168.204.48@tcp:503:mount.lustre.0 Request processed in 270us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.711947:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 302 00000100:00100000:3.0:1789185650.715343:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185650.715459:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879440000 00000100:00100000:1.0:1789185650.715487:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879440000 00000100:00100000:1.0:1789185650.715565:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 303 00000100:00100000:1.0:1789185650.715578:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:8722:x1876096879440000:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185650.715784:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:8722:x1876096879440000:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 207us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185650.715793:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 303 00000100:00100000:3.0:1789185650.719090:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.719261:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879440128 00000100:00100000:0.0:1789185650.719276:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879440128 00000100:00100000:0.0:1789185650.719349:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 304 00000100:00100000:0.0:1789185650.719361:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:8722:x1876096879440128:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185650.719579:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:8722:x1876096879440128:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 220us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.719589:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 304 00000100:00100000:3.0:1789185650.725844:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185650.725899:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.727557:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879441024 00000100:00100000:0.0:1789185650.727575:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879441024 00000100:00100000:0.0:1789185650.727642:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879440896 00000100:00100000:0.0:1789185650.727645:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879440896 00000100:00100000:0.0:1789185650.727678:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 133 00000100:00100000:0.0:1789185650.727690:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879441024:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185650.727803:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879441024:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 115us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.727811:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 133 00000100:00100000:0.0:1789185650.727829:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 134 00000100:00100000:0.0:1789185650.727835:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879440896:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185650.727856:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879440896:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 22us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.727862:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 134 00000100:00100000:3.0:1789185650.734564:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185650.734627:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185650.735226:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879440256 00000100:00100000:2.0:1789185650.735243:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879440256 00000100:00100000:2.0:1789185650.735300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879440512 00000100:00100000:2.0:1789185650.735304:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879440512 00000100:00100000:2.0:1789185650.735340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00100000:2.0:1789185650.735350:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876096879440256:12345-192.168.204.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789185650.735400:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from cc75c41c-3996-44b9-8c8f-b4e6d0f7796c@192.168.204.48@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1789185650.735446:0:6513:0:(genops.c:1384:class_connect()) connect: client cc75c41c-3996-44b9-8c8f-b4e6d0f7796c, cookie 0xda5c730d5a72e8f 00000004:00100000:2.0:1789185650.735478:0:6513:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789185650.735624:0:6513:0:(import.c:65:import_set_state_nolock()) ffff98f1c3523000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185650.735852:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:1.0:1789185650.735859:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876096879440512:12345-192.168.204.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789185650.735879:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from cc75c41c-3996-44b9-8c8f-b4e6d0f7796c@192.168.204.48@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1789185650.735941:0:6514:0:(genops.c:1384:class_connect()) connect: client cc75c41c-3996-44b9-8c8f-b4e6d0f7796c, cookie 0xda5c730d5a72e96 00000004:00100000:1.0:1789185650.735958:0:6514:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789185650.736230:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2388:x1876096879440256:12345-192.168.204.48@tcp:38:mount.lustre.0 Request processed in 879us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185650.736261:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00080000:1.0:1789185650.740284:0:6514:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185650.741311:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2388:x1876096879440512:12345-192.168.204.48@tcp:38:mount.lustre.0 Request processed in 5440us (6672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185650.741328:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:2.0:1789185650.743389:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185650.743556:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185650.743645:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879440768 00000100:00100000:1.0:1789185650.743659:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879440768 00000100:00100000:1.0:1789185650.743745:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879440384 00000100:00100000:1.0:1789185650.743749:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879440384 00000100:00100000:1.0:1789185650.743771:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:1.0:1789185650.743783:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+7:8713:x1876096879440768:12345-192.168.204.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789185650.743832:0:6513:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789185650.743959:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+7:8713:x1876096879440768:12345-192.168.204.48@tcp:41:mount.lustre.0 Request processed in 177us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185650.743967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:1.0:1789185650.744127:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:1.0:1789185650.744136:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:0:x1876096879440384:12345-192.168.204.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789185650.744149:0:6513:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789185650.744175:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:0:x1876096879440384:12345-192.168.204.48@tcp:41:mount.lustre.0 Request processed in 39us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185650.744181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00080000:2.0:1789185650.744396:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185650.747315:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185650.747386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879441152 00000100:00100000:1.0:1789185650.747401:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879441152 00000100:00100000:2.0:1789185650.747423:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185650.747937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879440640 00000100:00100000:1.0:1789185650.747944:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879440640 00000100:00080000:2.0:1789185650.748026:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185650.748166:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:0.0:1789185650.748181:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:8713:x1876096879441152:12345-192.168.204.48@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789185650.748238:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:3.0:1789185650.748249:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:0:x1876096879440640:12345-192.168.204.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789185650.748286:0:6513:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185650.748299:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:8713:x1876096879441152:12345-192.168.204.48@tcp:40:mount.lustre.0 Request processed in 122us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.748306:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:3.0:1789185650.748349:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:0:x1876096879440640:12345-192.168.204.48@tcp:41:mount.lustre.0 Request processed in 103us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185650.748357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:3.0:1789185650.752284:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.752878:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879441280 00000100:00100000:0.0:1789185650.753011:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879441280 00000100:00100000:0.0:1789185650.753103:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:0.0:1789185650.753114:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876096879441280:12345-192.168.204.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789185650.753161:0:9819:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from cc75c41c-3996-44b9-8c8f-b4e6d0f7796c@192.168.204.48@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:0.0:1789185650.753209:0:9819:0:(genops.c:1384:class_connect()) connect: client cc75c41c-3996-44b9-8c8f-b4e6d0f7796c, cookie 0xda5c730d5a72e9d 00002000:00100000:0.0:1789185650.753224:0:9819:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cc75c41c-3996-44b9-8c8f-b4e6d0f7796c/ffff98f1c35c5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789185650.753248:0:9819:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789185650.753345:0:9819:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789185650.753388:0:9819:0:(import.c:65:import_set_state_nolock()) ffff98f1c35c7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185650.753477:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2388:x1876096879441280:12345-192.168.204.48@tcp:8:mount.lustre.0 Request processed in 362us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.753486:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:2.0:1789185650.757179:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185650.757535:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.757723:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879441408 00000100:00100000:0.0:1789185650.757738:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879441408 00000100:00100000:0.0:1789185650.757811:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:0.0:1789185650.757822:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876096879441408:12345-192.168.204.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789185650.757870:0:8429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cc75c41c-3996-44b9-8c8f-b4e6d0f7796c@192.168.204.48@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:0.0:1789185650.757954:0:8429:0:(genops.c:1384:class_connect()) connect: client cc75c41c-3996-44b9-8c8f-b4e6d0f7796c, cookie 0xda5c730d5a72ea4 00002000:00100000:0.0:1789185650.757978:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cc75c41c-3996-44b9-8c8f-b4e6d0f7796c/ffff98f1c35c2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789185650.758004:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789185650.758123:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789185650.758170:0:8429:0:(import.c:65:import_set_state_nolock()) ffff98f1c35c4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185650.758276:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2388:x1876096879441408:12345-192.168.204.48@tcp:8:mount.lustre.0 Request processed in 453us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.758290:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:3.0:1789185650.759121:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879441536 00000100:00100000:3.0:1789185650.759131:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879441536 00000100:00100000:3.0:1789185650.759179:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:3.0:1789185650.759188:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:8713:x1876096879441536:12345-192.168.204.48@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789185650.759272:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:8713:x1876096879441536:12345-192.168.204.48@tcp:900:mount.lustre.0 Request processed in 85us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185650.759279:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:2.0:1789185650.762198:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185650.762383:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879441664 00000100:00100000:0.0:1789185650.762396:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879441664 00000100:00100000:0.0:1789185650.762477:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 1 00000100:00100000:0.0:1789185650.762490:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:8713:x1876096879441664:12345-192.168.204.48@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789185650.763057:0:6515:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789185650.763217:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:8713:x1876096879441664:12345-192.168.204.48@tcp:33:mount.lustre.0 Request processed in 728us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185650.763227:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 1 00010000:00010000:1.0:1789185650.984022:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185651.110249:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185651.110282:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898389888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185651.110383:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185651.110727:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898390400:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.110764:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185651.110784:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898390912:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.110801:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185651.110814:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898391424:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.110830:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185651.110855:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789185651.110860:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898390272:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.110888:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185651.110926:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898390784:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.110952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185651.111220:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898390016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185651.111321:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898390400 00000100:00100000:3.0:1789185651.111331:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898390400 00000100:00100000:3.0:1789185651.111386:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898390912 00000100:00100000:3.0:1789185651.111390:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898390912 00000100:00100000:3.0:1789185651.111422:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898391424 00000100:00100000:3.0:1789185651.111425:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898391424 00000100:00100000:3.0:1789185651.111445:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789185651.111455:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898390400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185651.113219:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898390400:12345-0@lo:400:kworker.0 Request processed in 1750us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185651.113240:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789185651.113301:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789185651.113322:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898390912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185651.113397:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898390912:12345-0@lo:400:kworker.0 Request processed in 87us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185651.113403:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789185651.113416:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789185651.113423:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898391424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185651.113453:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898391424:12345-0@lo:400:kworker.0 Request processed in 32us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185651.113460:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1789185651.113890:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185651.113957:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898390272 00000100:00100000:3.0:1789185651.113969:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898390272 00000100:00100000:3.0:1789185651.114025:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789185651.114032:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898390272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185651.115772:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898389888 00000100:00100000:2.0:1789185651.115790:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898389888 00000100:00080000:2.0:1789185651.115839:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185651.115930:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789185651.115945:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898389888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789185651.115975:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185651.116491:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898390144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185651.117725:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898390272:12345-0@lo:400:kworker.0 Request processed in 3686us (6827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185651.117743:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185651.117761:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789185651.117849:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898390784 00000100:00100000:3.0:1789185651.117858:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898390784 00000100:00100000:3.0:1789185651.117930:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789185651.117939:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898390784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185651.118009:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898390784:12345-0@lo:400:kworker.0 Request processed in 71us (7056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185651.118016:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789185651.118408:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898390528:0@lo:400:kworker.0 00000100:00100000:3.0:1789185651.118491:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898390016 00000100:00100000:3.0:1789185651.118497:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898390016 00000100:00100000:3.0:1789185651.118579:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789185651.118587:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2e97050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898390016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185651.118622:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789185651.118663:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2e97050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898390016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185651.118670:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789185651.118794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185651.118869:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898391040:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.118991:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185651.119040:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898391552:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119101:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185651.119195:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898390016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185651.119199:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898390528 00000100:00100000:3.0:1789185651.119207:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898390528 00000100:00100000:3.0:1789185651.119233:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789185651.119246:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898390528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119260:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898391040 00000100:00100000:0.0:1789185651.119268:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898391040 00000100:00100000:0.0:1789185651.119319:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898391552 00000100:00100000:0.0:1789185651.119323:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898391552 00000100:00100000:0.0:1789185651.119347:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789185651.119355:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898391040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119409:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898391040:12345-0@lo:400:kworker.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185651.119416:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789185651.119437:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789185651.119447:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898391552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185651.119457:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898390528:12345-0@lo:400:kworker.0 Request processed in 213us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185651.119466:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789185651.119498:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898391552:12345-0@lo:400:kworker.0 Request processed in 51us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185651.119506:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789185651.119540:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898390528:0@lo:400:kworker.0 00010000:00080000:0.0:1789185651.119552:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e3800 x1876096898391040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185651.119565:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898391040:0@lo:400:kworker.0 00010000:00080000:0.0:1789185651.119577:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33edc00 x1876096898391552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789185651.119584:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185651.119589:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898391552:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119644:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898390784:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119660:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898391296:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119703:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185651.119734:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898390400:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119749:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898390912:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119760:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898391424:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119792:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898390272:0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.119813:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898391296 00000100:00100000:0.0:1789185651.119817:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898391296 00000100:00100000:0.0:1789185651.119861:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789185651.119872:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898391296:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789185651.119882:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185651.119955:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898391296:12345-0@lo:400:kworker.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185651.119962:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789185651.119989:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e2300 x1876096898391296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185651.119998:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898391296:0@lo:400:kworker.0 00000100:00100000:1.0:1789185651.122812:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185651.122844:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898389888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6901us (12456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185651.122861:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789185651.123008:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898390144 00000100:00100000:0.0:1789185651.123021:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898390144 00000100:00100000:0.0:1789185651.123094:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789185651.123105:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898390144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185651.123136:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185651.123196:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898390144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185651.123223:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789185651.123246:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185651.123392:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898390656:0@lo:400:kworker.0 00000100:00100000:1.0:1789185651.123544:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185651.123578:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898391168:0@lo:400:kworker.0 00000100:00100000:1.0:1789185651.123604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185651.123628:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898391680:0@lo:400:kworker.0 00000100:00100000:1.0:1789185651.123647:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789185651.123702:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b7800 x1876096898390144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185651.123725:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898390144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185651.123771:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898391168 00000100:00100000:1.0:1789185651.123775:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898391168 00000100:00100000:1.0:1789185651.123815:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898391680 00000100:00100000:1.0:1789185651.123819:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898391680 00000100:00100000:1.0:1789185651.123841:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185651.123848:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898391168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.124042:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898390656 00000100:00100000:0.0:1789185651.124047:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898390656 00000100:00100000:0.0:1789185651.124077:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789185651.124084:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898390656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.124122:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898390656:12345-0@lo:400:kworker.0 Request processed in 39us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185651.124128:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789185651.124174:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789185651.124255:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898391168:12345-0@lo:400:kworker.0 Request processed in 407us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185651.124262:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789185651.124296:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898390656:0@lo:400:kworker.0 00010000:00080000:1.0:1789185651.124308:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e2d80 x1876096898391168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185651.124317:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898391168:0@lo:400:kworker.0 00000100:00080000:1.0:1789185651.124353:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185651.124489:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898391680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185651.124526:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898391680:12345-0@lo:400:kworker.0 Request processed in 345us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185651.124533:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789185651.124597:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33edf80 x1876096898391680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185651.124606:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898391680:0@lo:400:kworker.0 00010000:00080000:3.0:1789185651.124736:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7494a80 x1876096898389888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185651.124771:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898389888:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789185652.006342:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185652.648168:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185652.648190:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898391808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185652.648289:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185652.648355:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898391808 00000100:00100000:0.0:1789185652.648363:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898391808 00000100:00100000:0.0:1789185652.648410:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789185652.648419:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898391808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185652.648456:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185652.648500:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898391808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185652.648507:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789185652.648553:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898391808:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185653.032241:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185653.672117:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185653.672139:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898391936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185653.672216:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185653.672424:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898391936 00000100:00100000:0.0:1789185653.672433:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898391936 00000100:00100000:0.0:1789185653.672506:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789185653.672517:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898391936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185653.672547:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185653.672596:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898391936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185653.672603:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1789185653.672656:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7588e00 x1876096898391936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185653.672691:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898391936:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789185653.672943:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185653.675964:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185653.675990:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898392064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185653.676944:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185653.678173:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898392064 00000100:00100000:1.0:1789185653.678184:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898392064 00000100:00100000:1.0:1789185653.678266:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185653.678277:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898392064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185653.678304:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789185653.678747:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185653.678866:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898392064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 590us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185653.678892:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1789185653.686331:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7494000 x1876096898392064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185653.686654:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898392064:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789185654.054067:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185655.078183:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185656.102173:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185656.169314:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185656.169407:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185656.169443:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185656.169489:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185656.169511:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185656.169529:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185656.169569:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185656.169717:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879441792 00000100:00100000:1.0:1789185656.169728:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879441792 00000100:00100000:1.0:1789185656.169795:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 306 00000100:00100000:1.0:1789185656.169807:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879441792:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185656.169894:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879441792:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 88us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185656.169901:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 306 00000100:00100000:1.0:1789185656.169970:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879442560 00000100:00100000:1.0:1789185656.169975:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879442560 00000100:00100000:1.0:1789185656.170009:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879442432 00000100:00100000:1.0:1789185656.170012:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879442432 00000100:00100000:1.0:1789185656.170035:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00100000:1.0:1789185656.170042:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2390:x1876096879442560:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185656.170072:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2390:x1876096879442560:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185656.170078:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00100000:1.0:1789185656.170090:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00100000:1.0:1789185656.170096:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2390:x1876096879442432:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185656.170119:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2390:x1876096879442432:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185656.170126:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00080000:1.0:1789185656.170146:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185656.170157:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185656.170680:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879442048 00000100:00100000:0.0:1789185656.170687:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879442048 00000100:00100000:0.0:1789185656.170737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879442304 00000100:00100000:0.0:1789185656.170741:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879442304 00000100:00100000:0.0:1789185656.170756:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879441920 00000100:00100000:0.0:1789185656.170760:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879441920 00000100:00100000:0.0:1789185656.170774:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879442176 00000100:00100000:0.0:1789185656.170776:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879442176 00000100:00100000:0.0:1789185656.170794:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 141 00000100:00100000:0.0:1789185656.170802:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879442048:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185656.170839:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879442048:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 38us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.170845:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 141 00000100:00100000:0.0:1789185656.170859:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 142 00000100:00100000:0.0:1789185656.170865:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2390:x1876096879442304:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185656.170943:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2390:x1876096879442304:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 78us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.170950:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 142 00000100:00100000:0.0:1789185656.170964:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 143 00000100:00100000:0.0:1789185656.170970:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879441920:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185656.170994:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879441920:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.171000:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 143 00000100:00100000:0.0:1789185656.171014:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 144 00000100:00100000:0.0:1789185656.171021:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2390:x1876096879442176:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185656.171044:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2390:x1876096879442176:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.171049:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 144 00000100:00080000:1.0:1789185656.172143:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185656.172151:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185656.230256:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898392192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185656.230347:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185656.230640:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898392192 00000100:00100000:1.0:1789185656.230649:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898392192 00000100:00100000:1.0:1789185656.230719:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789185656.230730:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898392192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185656.230765:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185656.230813:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898392192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185656.230820:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789185656.230942:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898392320:0@lo:400:kworker.0 00000100:00100000:2.0:1789185656.230992:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185656.231012:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898392448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185656.231031:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898392832:0@lo:400:kworker.0 00000100:00100000:2.0:1789185656.231061:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185656.231081:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898393344:0@lo:400:kworker.0 00000100:00100000:1.0:1789185656.231100:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185656.231115:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185656.231135:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898392960:0@lo:400:kworker.0 00000100:00100000:2.0:1789185656.231143:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898393856:0@lo:400:kworker.0 00000100:00100000:1.0:1789185656.231164:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185656.231183:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185656.231186:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898393472:0@lo:400:kworker.0 00000100:00100000:2.0:1789185656.231221:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898392320 00000100:00100000:2.0:1789185656.231226:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898392320 00000100:00100000:1.0:1789185656.231231:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185656.231270:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898393344 00000100:00100000:1.0:1789185656.231275:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898393344 00000100:00100000:2.0:1789185656.231279:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789185656.231290:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898392320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185656.231308:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898393856 00000100:00100000:1.0:1789185656.231312:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898393856 00000100:00100000:1.0:1789185656.231329:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898393472 00000100:00100000:1.0:1789185656.231331:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898393472 00000100:00100000:2.0:1789185656.231339:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898392320:12345-0@lo:400:kworker.0 Request processed in 51us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185656.231346:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789185656.231350:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789185656.231357:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898393344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185656.231393:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898393344:12345-0@lo:400:kworker.0 Request processed in 39us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185656.231399:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789185656.231475:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898392576:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.231502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185656.231518:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898393088:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.231535:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185656.231550:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898393600:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.231567:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185656.231583:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789185656.231588:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898392704:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.231620:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185656.231635:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898393216:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.231663:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185656.231679:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898393728:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.231696:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185656.231715:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898392448 00000100:00100000:0.0:1789185656.231719:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898392448 00000100:00100000:0.0:1789185656.231740:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898392960 00000100:00100000:0.0:1789185656.231743:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898392960 00000100:00100000:0.0:1789185656.231753:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898392704 00000100:00100000:0.0:1789185656.231755:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898392704 00000100:00100000:0.0:1789185656.231764:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789185656.231769:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898392448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185656.231792:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789185656.231823:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876096898392448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.231829:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789185656.231843:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789185656.231849:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898392960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.231874:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898392960:12345-0@lo:400:kworker.0 Request processed in 26us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.231880:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789185656.231890:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789185656.231896:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898392704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.231950:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898392704:12345-0@lo:400:kworker.0 Request processed in 53us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.231956:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789185656.231975:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898392832 00000100:00100000:0.0:1789185656.231984:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898392832 00000100:00100000:0.0:1789185656.232003:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898392576 00000100:00100000:0.0:1789185656.232005:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898392576 00000100:00100000:0.0:1789185656.232015:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898393088 00000100:00100000:0.0:1789185656.232016:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898393088 00000100:00100000:0.0:1789185656.232026:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898393600 00000100:00100000:0.0:1789185656.232028:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898393600 00000100:00100000:0.0:1789185656.232036:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898393216 00000100:00100000:0.0:1789185656.232038:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898393216 00000100:00100000:0.0:1789185656.232048:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898393728 00000100:00100000:0.0:1789185656.232050:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898393728 00000100:00100000:0.0:1789185656.232062:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789185656.232067:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898392832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232098:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898392832:12345-0@lo:400:kworker.0 Request processed in 30us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.232103:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789185656.232115:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789185656.232120:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898392576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232143:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898392576:12345-0@lo:400:kworker.0 Request processed in 24us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.232148:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789185656.232158:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789185656.232163:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898393088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232186:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898393088:12345-0@lo:400:kworker.0 Request processed in 23us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.232192:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789185656.232203:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789185656.232208:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898393600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232248:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898393600:12345-0@lo:400:kworker.0 Request processed in 40us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.232255:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789185656.232266:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789185656.232272:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898393216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232298:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898393216:12345-0@lo:400:kworker.0 Request processed in 26us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.232304:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789185656.232316:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789185656.232321:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898393728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232348:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898393728:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.232353:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789185656.232398:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898392704:0@lo:400:kworker.0 00010000:00080000:0.0:1789185656.232412:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b1500 x1876096898393216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185656.232422:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898393216:0@lo:400:kworker.0 00010000:00080000:0.0:1789185656.232432:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3560000 x1876096898393728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185656.232438:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898393728:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232446:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898392576:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232455:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898393088:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232475:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898393600:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232511:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898393984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185656.232538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185656.232570:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898392448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185656.232580:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898392960:0@lo:400:kworker.0 00000100:00100000:0.0:1789185656.232617:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898393984 00000100:00100000:0.0:1789185656.232621:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898393984 00000100:00100000:0.0:1789185656.232651:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789185656.232658:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876096898393984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185656.232671:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185656.232702:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876096898393984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185656.232708:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1789185656.232731:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7588e00 x1876096898393984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185656.232742:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898393984:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789185656.233105:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185656.233110:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185656.233112:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789185656.233114:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789185656.233140:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7494000 x1876096898392192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185656.233154:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898392192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185656.233340:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789185656.234498:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898393856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185656.234612:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898393856:12345-0@lo:400:kworker.0 Request processed in 1262us (3428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185656.234622:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789185656.234650:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789185656.234671:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898393472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185656.234721:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898393472:12345-0@lo:400:kworker.0 Request processed in 53us (3490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185656.234728:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789185656.234779:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898392832:0@lo:400:kworker.0 00010000:00080000:2.0:1789185656.234796:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3562300 x1876096898393344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185656.234805:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898393344:0@lo:400:kworker.0 00010000:00080000:2.0:1789185656.234816:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3562680 x1876096898393856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185656.234824:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898393856:0@lo:400:kworker.0 00000100:00100000:2.0:1789185656.234834:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898392320:0@lo:400:kworker.0 00010000:00080000:2.0:1789185656.235021:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3562d80 x1876096898393472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185656.235031:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898393472:0@lo:400:kworker.0 00000001:00100000:1.0:1789185656.751517:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000001:00100000:0.0:1789185656.752763:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000001:00100000:2.0:1789185656.757890:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000001:00100000:3.0:1789185656.760541:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00010000:00010000:1.0:1789185657.128599:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185657.767185:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185657.767208:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898394112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185657.767290:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185657.767478:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898394112 00000100:00100000:0.0:1789185657.767487:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898394112 00000100:00100000:0.0:1789185657.767555:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789185657.767579:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898394112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185657.767629:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185657.767687:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898394112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185657.767711:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789185657.767759:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898394112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185658.151289:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185658.325501:0:12185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789185658.790239:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898394240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185658.790369:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185658.790682:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898394240 00000100:00100000:3.0:1789185658.790690:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898394240 00000100:00100000:3.0:1789185658.790755:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789185658.790764:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f30119e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898394240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185658.790795:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185658.790859:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f30119e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898394240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185658.790866:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1789185658.791115:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7588e00 x1876096898394240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185658.791134:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898394240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185658.791324:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185658.791335:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898394368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185658.791368:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185658.791405:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898394368 00000100:00100000:2.0:1789185658.791409:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898394368 00000100:00100000:2.0:1789185658.791434:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789185658.791448:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898394368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185658.791461:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185658.791498:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898394368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185658.791504:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1789185658.791530:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f278ed80 x1876096898394368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185658.791555:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898394368:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789185658.791720:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789185659.174253:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185660.210269:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185661.222163:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185661.291853:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185661.291885:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185661.291955:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185661.291975:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185661.292004:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185661.292020:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185661.292055:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185661.292092:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879443456 00000100:00100000:3.0:1789185661.292104:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879443456 00000100:00100000:3.0:1789185661.292155:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879443328 00000100:00100000:3.0:1789185661.292158:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879443328 00000100:00100000:3.0:1789185661.292181:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:3.0:1789185661.292191:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879443456:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185661.292260:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879443456:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 70us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.292267:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:3.0:1789185661.292285:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:3.0:1789185661.292291:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879443328:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185661.292315:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879443328:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.292335:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:0.0:1789185661.293199:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879442688 00000100:00100000:0.0:1789185661.293208:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879442688 00000100:00100000:0.0:1789185661.293258:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 308 00000100:00100000:0.0:1789185661.293267:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879442688:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185661.293319:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879442688:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 54us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185661.293326:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 308 00000100:00100000:0.0:1789185661.293360:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879442944 00000100:00100000:0.0:1789185661.293364:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879442944 00000100:00100000:0.0:1789185661.293406:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879443200 00000100:00100000:0.0:1789185661.293410:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879443200 00000100:00100000:0.0:1789185661.293423:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879442816 00000100:00100000:0.0:1789185661.293426:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879442816 00000100:00100000:0.0:1789185661.293437:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879443072 00000100:00100000:0.0:1789185661.293440:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879443072 00000100:00100000:0.0:1789185661.293453:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 151 00000100:00100000:0.0:1789185661.293459:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879442944:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185661.293491:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879442944:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 31us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185661.293510:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 151 00000100:00100000:0.0:1789185661.293523:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 152 00000100:00100000:0.0:1789185661.293529:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879443200:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185661.293564:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879443200:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 35us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185661.293582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 152 00000100:00100000:0.0:1789185661.293596:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 153 00000100:00100000:0.0:1789185661.293602:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879442816:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185661.293627:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879442816:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185661.293633:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 153 00000100:00100000:0.0:1789185661.293644:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 154 00000100:00100000:0.0:1789185661.293651:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879443072:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185661.293673:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879443072:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 23us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185661.293679:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 154 00000100:00080000:1.0:1789185661.295991:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185661.296001:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185661.296005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185661.296008:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185661.356203:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898394624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185661.356274:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185661.356352:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898394624 00000100:00100000:1.0:1789185661.356360:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898394624 00000100:00100000:1.0:1789185661.356416:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789185661.356425:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898394624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185661.356455:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185661.356512:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898394624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185661.356519:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789185661.356552:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789185661.356583:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c2c04a80 x1876096898394624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185661.356622:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898394624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185661.356903:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185661.356955:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898394496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185661.356989:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185661.360446:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898394880:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.360526:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185661.360568:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898395392:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.360591:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185661.360617:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898395904:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.360638:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185661.360666:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789185661.360672:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898395008:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.360697:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185661.360715:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898395520:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.360733:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185661.360747:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898396032:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.360763:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185661.360790:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898394880 00000100:00100000:3.0:1789185661.360798:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898394880 00000100:00100000:3.0:1789185661.360834:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898395392 00000100:00100000:3.0:1789185661.360837:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898395392 00000100:00100000:3.0:1789185661.360856:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898395904 00000100:00100000:3.0:1789185661.360859:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898395904 00000100:00100000:3.0:1789185661.360871:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898395520 00000100:00100000:3.0:1789185661.360873:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898395520 00000100:00100000:3.0:1789185661.360883:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898396032 00000100:00100000:3.0:1789185661.360885:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898396032 00000100:00100000:3.0:1789185661.360897:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789185661.360904:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898394880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.360992:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898394880:12345-0@lo:400:kworker.0 Request processed in 87us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.360999:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789185661.361018:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789185661.361232:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898395392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.361268:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898395392:12345-0@lo:400:kworker.0 Request processed in 244us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.361276:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789185661.361290:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789185661.361297:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898395904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.361324:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898395904:12345-0@lo:400:kworker.0 Request processed in 28us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.361330:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789185661.361343:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789185661.361348:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898395520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.361375:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898395520:12345-0@lo:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.361380:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789185661.361390:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789185661.361397:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898396032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.361421:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898396032:12345-0@lo:400:kworker.0 Request processed in 25us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.361428:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789185661.361453:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898395008 00000100:00100000:3.0:1789185661.361457:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898395008 00000100:00100000:3.0:1789185661.361493:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789185661.361618:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898395008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.361654:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898395008:12345-0@lo:400:kworker.0 Request processed in 39us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.361660:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789185661.361716:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898395008:0@lo:400:kworker.0 00010000:00080000:3.0:1789185661.361730:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f2bda680 x1876096898395520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185661.361740:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898395520:0@lo:400:kworker.0 00010000:00080000:3.0:1789185661.361749:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b1f80 x1876096898396032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185661.361757:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898396032:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.361766:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898394880:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.361774:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898395392:0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.361782:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898395904:0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.361904:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898394496 00000100:00100000:1.0:1789185661.361920:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898394496 00000100:00100000:1.0:1789185661.361960:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789185661.361967:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898394496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185661.361981:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185661.362020:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898394496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (5030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185661.362038:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789185661.362065:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898394752:0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362097:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185661.362125:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898395264:0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362151:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185661.362170:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898395776:0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362193:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185661.362214:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789185661.362220:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898395136:0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362243:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185661.362260:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898395648:0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362279:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185661.362304:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898395264 00000100:00100000:1.0:1789185661.362308:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898395264 00000100:00100000:1.0:1789185661.362333:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789185661.362339:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898395264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362387:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898395264:12345-0@lo:400:kworker.0 Request processed in 48us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185661.362393:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789185661.362413:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898395776 00000100:00100000:1.0:1789185661.362416:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898395776 00000100:00100000:1.0:1789185661.362442:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898395648 00000100:00100000:1.0:1789185661.362446:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898395648 00000100:00100000:1.0:1789185661.362465:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789185661.362472:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898395776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362521:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898395776:12345-0@lo:400:kworker.0 Request processed in 50us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185661.362527:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789185661.362751:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789185661.362759:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898395648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362790:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898395648:12345-0@lo:400:kworker.0 Request processed in 33us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185661.362796:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1789185661.362823:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185661.362827:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185661.362829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185661.362832:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185661.362862:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f2bd9f80 x1876096898395648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185661.362874:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898395648:0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362884:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898395264:0@lo:400:kworker.0 00010000:00080000:1.0:1789185661.362893:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f2bdb480 x1876096898395776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185661.362936:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898395776:0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.362961:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898395136 00000100:00100000:1.0:1789185661.362965:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898395136 00000100:00100000:1.0:1789185661.362993:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789185661.363000:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898395136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185661.363111:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898395136:12345-0@lo:400:kworker.0 Request processed in 111us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185661.363119:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789185661.363149:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898395136:0@lo:400:kworker.0 00010000:00080000:1.0:1789185661.363173:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c37a6a00 x1876096898394496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185661.363189:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898394496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185661.377521:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898394752 00000100:00100000:3.0:1789185661.377536:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898394752 00000100:00100000:3.0:1789185661.377599:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789185661.377610:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898394752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185661.377702:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898394752:12345-0@lo:400:kworker.0 Request processed in 95us (15604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.377710:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789185661.377899:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898394752:0@lo:400:kworker.0 00000100:00100000:2.0:1789185661.381087:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185661.381110:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898396160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185661.381180:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185661.382830:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898396160 00000100:00100000:3.0:1789185661.382843:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898396160 00000100:00100000:3.0:1789185661.382898:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789185661.382930:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898396160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185661.382972:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789185661.383047:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898396160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185661.383053:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789185661.384060:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898396160:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789185662.256843:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185662.886930:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898396288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185662.887007:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185662.887137:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898396288 00000100:00100000:1.0:1789185662.887146:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898396288 00000100:00100000:1.0:1789185662.887195:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789185662.887204:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898396288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185662.887238:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185662.887297:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898396288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185662.887305:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789185662.887395:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898396288:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185663.272220:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185663.912582:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898396416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185663.912925:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185663.913020:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898396416 00000100:00100000:1.0:1789185663.913035:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898396416 00000100:00100000:1.0:1789185663.913090:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789185663.913100:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898396416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185663.914891:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185663.914986:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898396416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1885us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185663.914996:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789185663.915030:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185663.915069:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f278c700 x1876096898396416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185663.915092:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898396416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185663.916286:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898396544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185663.916348:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185663.916406:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898396544 00000100:00100000:3.0:1789185663.916413:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898396544 00000100:00100000:3.0:1789185663.917417:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789185663.917432:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898396544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185663.918275:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185663.918369:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898396544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 939us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185663.918378:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789185663.918411:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789185663.920243:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b7b80 x1876096898396544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185663.920282:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898396544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789185664.307704:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185665.318098:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185666.342254:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185666.413806:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185666.414234:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185666.414260:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185666.414304:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185666.414325:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185666.414357:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185666.414383:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185666.417063:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879443840 00000100:00100000:0.0:1789185666.417093:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879443840 00000100:00080000:3.0:1789185666.422140:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185666.422203:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879444096 00000100:00100000:0.0:1789185666.422215:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879444096 00000100:00100000:0.0:1789185666.422250:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879443712 00000100:00100000:0.0:1789185666.422253:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879443712 00000100:00100000:0.0:1789185666.422267:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879443968 00000100:00100000:0.0:1789185666.422270:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879443968 00000100:00100000:0.0:1789185666.422294:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 161 00000100:00100000:0.0:1789185666.422304:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879443840:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185666.425942:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879443584 00000100:00100000:2.0:1789185666.425958:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879443584 00000100:00100000:2.0:1789185666.426057:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 310 00000100:00100000:2.0:1789185666.426068:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879443584:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185666.426109:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879443840:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 3803us (11873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185666.426135:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879443584:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 67us (12343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185666.426147:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 310 00000100:00100000:0.0:1789185666.426147:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 161 00000100:00100000:0.0:1789185666.426178:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 162 00000100:00100000:0.0:1789185666.426188:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879444096:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185666.426225:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879444096:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 40us (11964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.426231:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 162 00000100:00080000:2.0:1789185666.426235:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185666.426247:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 163 00000100:00080000:2.0:1789185666.426250:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185666.426257:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879443712:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185666.426283:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879443712:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 29us (11957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.426288:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 163 00000100:00100000:0.0:1789185666.426299:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 164 00000100:00100000:0.0:1789185666.426306:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879443968:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185666.426327:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879443968:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 22us (11970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.426332:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 164 00000100:00100000:1.0:1789185666.428279:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879444352 00000100:00100000:1.0:1789185666.428300:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879444352 00000100:00100000:1.0:1789185666.428438:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879444224 00000100:00100000:1.0:1789185666.428442:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879444224 00000100:00100000:1.0:1789185666.428489:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 64 00000100:00100000:1.0:1789185666.428502:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879444352:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185666.428611:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879444352:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 111us (14306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185666.428620:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 64 00000100:00100000:1.0:1789185666.428639:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00100000:1.0:1789185666.428646:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879444224:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185666.428676:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879444224:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 31us (14293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185666.428683:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00080000:2.0:1789185666.429704:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185666.429714:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185666.471020:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185666.471057:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898396672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185666.471194:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185666.471317:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898396672 00000100:00100000:1.0:1789185666.471328:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898396672 00000100:00100000:1.0:1789185666.471425:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789185666.471436:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898396672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185666.471477:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185666.471529:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898396672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185666.471537:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1789185666.471590:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ec700 x1876096898396672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185666.471610:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898396672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185666.472116:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898396928:0@lo:400:kworker.0 00000100:00100000:1.0:1789185666.472157:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185666.472185:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898397440:0@lo:400:kworker.0 00000100:00100000:1.0:1789185666.472219:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185666.472245:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898397952:0@lo:400:kworker.0 00000100:00100000:1.0:1789185666.472278:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185666.472303:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789185666.472309:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898397056:0@lo:400:kworker.0 00000100:00100000:2.0:1789185666.472833:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898397184:0@lo:400:kworker.0 00000100:00100000:2.0:1789185666.472940:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185666.472976:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898397696:0@lo:400:kworker.0 00000100:00100000:2.0:1789185666.473137:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185666.473160:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898398208:0@lo:400:kworker.0 00000100:00100000:2.0:1789185666.473180:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185666.473205:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789185666.473211:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898396800:0@lo:400:kworker.0 00000100:00100000:2.0:1789185666.473235:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185666.473262:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898397312:0@lo:400:kworker.0 00000100:00080000:3.0:1789185666.473786:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185666.473802:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898398336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185666.474478:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898396928 00000100:00100000:0.0:1789185666.474490:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898396928 00000100:00100000:2.0:1789185666.474554:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185666.474561:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898397440 00000100:00100000:0.0:1789185666.474566:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898397440 00000100:00100000:0.0:1789185666.474599:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898397952 00000100:00100000:0.0:1789185666.474602:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898397952 00000100:00100000:0.0:1789185666.474617:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898397184 00000100:00100000:2.0:1789185666.474619:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898397824:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.474622:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898397184 00000100:00100000:0.0:1789185666.474643:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789185666.474677:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898396928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185666.474684:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185666.474713:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185666.474747:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898396800 00000100:00100000:2.0:1789185666.474755:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898396800 00000100:00100000:0.0:1789185666.474774:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898396928:12345-0@lo:400:kworker.0 Request processed in 101us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185666.474776:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898397568:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.474797:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789185666.474820:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789185666.474827:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898397440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185666.476899:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789185666.476935:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898396800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185666.477709:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185666.477766:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898397440:12345-0@lo:400:kworker.0 Request processed in 2934us (5540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.477780:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789185666.477812:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898397568 00000100:00100000:0.0:1789185666.477822:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898397568 00000100:00100000:0.0:1789185666.477853:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789185666.477861:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898397952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185666.479305:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185666.479336:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898398464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185666.480286:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898397952:12345-0@lo:400:kworker.0 Request processed in 2416us (8008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.480301:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789185666.480346:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789185666.480362:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898397184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.482232:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898397184:12345-0@lo:400:kworker.0 Request processed in 1866us (9281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.482246:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789185666.482332:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898397184:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.482372:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789185666.482384:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898397568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.482443:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898397568:12345-0@lo:400:kworker.0 Request processed in 64us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.482465:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00010000:00080000:0.0:1789185666.482545:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ed500 x1876096898397568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185666.482558:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898397568:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.482572:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898398080:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.482616:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185666.482651:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898396928:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.482665:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898397440:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.482678:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898397952:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.482702:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898398080 00000100:00100000:0.0:1789185666.482709:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898398080 00000100:00100000:0.0:1789185666.482762:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789185666.482769:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898398080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.483005:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898398080:12345-0@lo:400:kworker.0 Request processed in 235us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.483013:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789185666.483051:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789185666.483052:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ef800 x1876096898398080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185666.483068:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898398080:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.483126:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898397696 00000100:00100000:0.0:1789185666.483132:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898397696 00000100:00100000:1.0:1789185666.483163:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898397312 00000100:00100000:1.0:1789185666.483174:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898397312 00000100:00100000:0.0:1789185666.483183:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898398208 00000100:00100000:0.0:1789185666.483189:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898398208 00000100:00100000:0.0:1789185666.483228:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898397824 00000100:00100000:0.0:1789185666.483232:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898397824 00000100:00100000:1.0:1789185666.483245:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898397056 00000100:00100000:1.0:1789185666.483252:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898397056 00000100:00100000:0.0:1789185666.483257:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789185666.483270:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185666.483289:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789185666.483325:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898397696:12345-0@lo:400:kworker.0 Request processed in 59us (10186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.483331:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789185666.483344:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789185666.483349:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898398208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.483381:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898398208:12345-0@lo:400:kworker.0 Request processed in 32us (10199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.483386:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789185666.483396:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789185666.483416:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898397824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.483449:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898397824:12345-0@lo:400:kworker.0 Request processed in 35us (8769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.483454:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1789185666.483483:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ef100 x1876096898397824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185666.483494:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898397824:0@lo:400:kworker.0 00010000:00080000:0.0:1789185666.483506:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36eed80 x1876096898397696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185666.483515:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898397696:0@lo:400:kworker.0 00010000:00080000:0.0:1789185666.483527:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36eea00 x1876096898398208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185666.483549:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898398208:0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.483585:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898398464 00000100:00100000:0.0:1789185666.483590:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898398464 00000100:00100000:0.0:1789185666.483619:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789185666.483626:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898398464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185666.483643:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185666.483684:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898398464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.483690:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789185666.484422:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789185666.484442:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898397056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185666.484561:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898397056:12345-0@lo:400:kworker.0 Request processed in 129us (9854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.484569:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789185666.485122:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898397056:0@lo:400:kworker.0 00010000:00080000:0.0:1789185666.485188:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7588000 x1876096898398464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185666.485208:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898398464:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789185666.485280:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185666.485287:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185666.485302:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185666.485306:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185666.485853:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898397312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185666.486447:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898397312:12345-0@lo:400:kworker.0 Request processed in 658us (11893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185666.486456:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789185666.488893:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185666.489134:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898397312:0@lo:400:kworker.0 00000100:00100000:1.0:1789185666.489275:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898398336 00000100:00100000:1.0:1789185666.489292:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898398336 00000100:00100000:1.0:1789185666.489379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789185666.489391:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898398336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185666.489456:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789185666.489573:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898398336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 185us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185666.489582:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789185666.494466:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898398336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185666.494583:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898396800:12345-0@lo:400:kworker.0 Request processed in 17646us (21341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185666.494597:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898396800:0@lo:400:kworker.0 00000100:00100000:2.0:1789185666.494602:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00010000:1.0:1789185667.369501:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185668.008383:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898398592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185668.008452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185668.008556:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898398592 00000100:00100000:1.0:1789185668.008564:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898398592 00000100:00100000:1.0:1789185668.008613:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789185668.008624:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898398592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185668.008657:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185668.008705:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898398592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185668.008721:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789185668.008764:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898398592:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185668.392568:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185669.030580:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185669.030607:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898398720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185669.030682:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185669.030801:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898398720 00000100:00100000:3.0:1789185669.030810:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898398720 00000100:00100000:3.0:1789185669.030876:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789185669.030886:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898398720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185669.030938:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185669.030983:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898398720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185669.030990:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789185669.031465:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185669.031504:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f2bdb480 x1876096898398720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185669.031524:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898398720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185669.032493:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185669.049029:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898398848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185669.049128:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185669.049703:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898398848 00000100:00100000:0.0:1789185669.049729:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898398848 00000100:00100000:0.0:1789185669.049798:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789185669.049808:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898398848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185669.049834:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185669.049890:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898398848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185669.049898:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789185669.050031:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185669.050065:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b5c00 x1876096898398848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185669.050096:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898398848:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789185669.422799:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789185670.146681:0:12515:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185670.149227:0:12515:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789185670.447074:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185671.462272:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185671.548489:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185671.548535:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185671.548565:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185671.548599:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185671.548618:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185671.548634:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185671.548651:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879445120 00000100:00100000:1.0:1789185671.548657:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185671.548661:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879445120 00000100:00100000:2.0:1789185671.548733:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879444480 00000100:00100000:2.0:1789185671.548737:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879444480 00000100:00100000:3.0:1789185671.548742:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879445248 00000100:00100000:3.0:1789185671.548751:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879445248 00000100:00100000:2.0:1789185671.548769:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 312 00000100:00100000:3.0:1789185671.548773:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:2.0:1789185671.548778:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879444480:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185671.548779:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2388:x1876096879445120:12345-192.168.204.48@tcp:9:kworker.0 00000020:00000080:3.0:1789185671.548841:0:8427:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72e9d 00000100:00100000:2.0:1789185671.548845:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879444480:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 68us (367us total) trans 0 rc 0/0 00000100:00080000:3.0:1789185671.548851:0:8427:0:(import.c:65:import_set_state_nolock()) ffff98f1c35c7000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789185671.548852:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 312 00000001:00000004:3.0:1789185671.548899:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789185671.548943:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:0.0:1789185671.548952:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2388:x1876096879445248:12345-192.168.204.48@tcp:9:kworker.0 00000020:00000080:0.0:1789185671.548965:0:8430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72ea4 00000100:00080000:0.0:1789185671.548971:0:8430:0:(import.c:65:import_set_state_nolock()) ffff98f1c35c4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789185671.549036:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789185671.549065:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+2:2388:x1876096879445120:12345-192.168.204.48@tcp:9:kworker.0 Request processed in 286us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185671.549072:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00010000:00010000:3.0:1789185671.549093:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185671.549112:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+2:2388:x1876096879445248:12345-192.168.204.48@tcp:9:kworker.0 Request processed in 161us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185671.549119:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:0.0:1789185671.549138:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879444736 00000100:00100000:0.0:1789185671.549141:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879444736 00000100:00100000:0.0:1789185671.549177:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879444608 00000100:00100000:0.0:1789185671.549181:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879444608 00000100:00100000:0.0:1789185671.549194:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879444864 00000100:00100000:0.0:1789185671.549196:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879444864 00000100:00100000:0.0:1789185671.549207:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879444992 00000100:00100000:0.0:1789185671.549209:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879444992 00000100:00100000:3.0:1789185671.549214:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 171 00000100:00100000:3.0:1789185671.549221:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879444736:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185671.549222:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 172 00000100:00100000:0.0:1789185671.549234:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879444608:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185671.549250:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879444736:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185671.549255:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879444608:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 22us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185671.549256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 171 00000100:00100000:0.0:1789185671.549261:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 172 00000100:00100000:3.0:1789185671.549269:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 173 00000100:00100000:3.0:1789185671.549275:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879444864:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185671.549297:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879444864:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 23us (662us total) trans 0 rc 0/0 00010000:00010000:2.0:1789185671.549313:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185671.549351:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185671.549355:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185671.549358:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185671.549360:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185671.552200:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 174 00000100:00100000:0.0:1789185671.552229:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879444992:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185671.552315:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879444992:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 90us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185671.552324:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 174 00000100:00100000:3.0:1789185671.555586:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 173 00000100:00100000:0.0:1789185671.594879:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898398976:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595120:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898399488:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595147:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595166:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898400000:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595187:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595204:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898400512:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595224:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595247:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789185671.595253:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898399104:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595275:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595293:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898399616:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595325:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595341:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898400128:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595369:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595397:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898399232:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595459:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595478:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898399744:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595501:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595519:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898400256:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.595539:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.595557:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789185671.595563:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898399360:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.596185:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.596200:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898399872:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.596220:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.596237:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898400384:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.596255:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185671.607537:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185671.607568:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898400768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185671.607641:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185671.607701:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898400000 00000100:00100000:3.0:1789185671.607708:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898400000 00000100:00100000:2.0:1789185671.610083:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898399488 00000100:00100000:2.0:1789185671.610098:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898399488 00000100:00100000:2.0:1789185671.610138:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898399232 00000100:00100000:2.0:1789185671.610141:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898399232 00000100:00100000:2.0:1789185671.610152:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898400768 00000100:00100000:2.0:1789185671.610155:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898400768 00000100:00100000:2.0:1789185671.610181:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789185671.610191:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898399488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185671.610282:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898399488:12345-0@lo:400:kworker.0 Request processed in 93us (15134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185671.610289:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789185671.610318:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789185671.610325:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898399232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185671.610355:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898399232:12345-0@lo:400:kworker.0 Request processed in 31us (14896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185671.610361:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789185671.610372:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789185671.610377:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898400768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185671.610405:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185671.610451:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898400768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185671.610457:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789185671.610505:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898400768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185671.610678:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898400512 00000100:00100000:3.0:1789185671.610683:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898400512 00000100:00100000:3.0:1789185671.610705:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898399872 00000100:00100000:3.0:1789185671.610708:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898399872 00000100:00100000:3.0:1789185671.610943:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898400384 00000100:00100000:3.0:1789185671.610947:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898400384 00000100:00100000:3.0:1789185671.610966:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789185671.610974:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898400000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.610993:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898398976 00000100:00100000:0.0:1789185671.610997:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898398976 00000100:00100000:3.0:1789185671.611014:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898400000:12345-0@lo:400:kworker.0 Request processed in 42us (15826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185671.611020:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789185671.611033:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789185671.611039:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898400512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185671.611066:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898400512:12345-0@lo:400:kworker.0 Request processed in 28us (15841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185671.611073:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789185671.611083:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789185671.611089:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898399872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185671.611116:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898399872:12345-0@lo:400:kworker.0 Request processed in 28us (14895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185671.611122:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789185671.611135:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789185671.611141:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898400384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185671.611164:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898400384:12345-0@lo:400:kworker.0 Request processed in 24us (14908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185671.611169:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789185671.611184:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789185671.611187:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185671.611325:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789185671.611332:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898398976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.611368:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898398976:12345-0@lo:400:kworker.0 Request processed in 37us (16367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185671.611374:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789185671.611410:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898399104 00000100:00100000:0.0:1789185671.611414:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898399104 00000100:00100000:0.0:1789185671.611431:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898399616 00000100:00100000:0.0:1789185671.611433:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898399616 00000100:00080000:3.0:1789185671.611457:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185671.611458:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898400128 00000100:00100000:0.0:1789185671.611466:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898400128 00000100:00080000:3.0:1789185671.611484:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185671.611491:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898399744 00000100:00100000:0.0:1789185671.611494:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898399744 00000100:00080000:3.0:1789185671.611510:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185671.611514:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898400256 00000100:00100000:0.0:1789185671.611517:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898400256 00000100:00080000:3.0:1789185671.611531:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185671.611536:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898399360 00000100:00100000:0.0:1789185671.611539:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898399360 00000100:00100000:0.0:1789185671.611551:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789185671.611556:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898399104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.612093:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898399104:12345-0@lo:400:kworker.0 Request processed in 534us (16814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185671.612101:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789185671.612117:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789185671.612125:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898399616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.612154:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898399616:12345-0@lo:400:kworker.0 Request processed in 31us (16828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185671.612159:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789185671.612171:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789185671.612175:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898400128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.612199:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898400128:12345-0@lo:400:kworker.0 Request processed in 23us (16829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185671.612204:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789185671.612214:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789185671.612219:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898399744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.612243:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898399744:12345-0@lo:400:kworker.0 Request processed in 24us (16741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185671.612248:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789185671.612266:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789185671.612271:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898400256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.612298:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898400256:12345-0@lo:400:kworker.0 Request processed in 27us (16758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185671.613463:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898400896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185671.613518:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185671.613565:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898400896 00000100:00100000:2.0:1789185671.613583:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898400896 00000100:00100000:2.0:1789185671.613619:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789185671.613625:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898400896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789185671.613651:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185671.613687:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898400896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185671.613698:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1789185671.613737:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f2bdaa00 x1876096898400896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185671.613754:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898400896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185671.613961:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789185671.613992:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789185671.614000:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898399360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.614460:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898399360:12345-0@lo:400:kworker.0 Request processed in 459us (18274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185671.614467:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789185671.614525:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898400640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185671.614554:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185671.614825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898399360:0@lo:400:kworker.0 00010000:00080000:0.0:1789185671.614842:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36eea00 x1876096898399872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185671.614853:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898399872:0@lo:400:kworker.0 00010000:00080000:0.0:1789185671.614864:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ed180 x1876096898400384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185671.614873:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898400384:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.614885:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898399232:0@lo:400:kworker.0 00010000:00080000:0.0:1789185671.614896:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36eca80 x1876096898399744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185671.614929:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898399744:0@lo:400:kworker.0 00010000:00080000:0.0:1789185671.614957:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ef800 x1876096898400256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185671.614978:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898400256:0@lo:400:kworker.0 00000100:00100000:2.0:1789185671.615495:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898400640 00000100:00100000:2.0:1789185671.615503:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898400640 00000100:00100000:2.0:1789185671.615544:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789185671.615552:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898400640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185671.615570:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185671.616176:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898399104:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.616190:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898399616:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.616201:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898400128:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.616211:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898398976:0@lo:400:kworker.0 00000100:00100000:0.0:1789185671.616221:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898399488:0@lo:400:kworker.0 00010000:00080000:0.0:1789185671.616234:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36eed80 x1876096898400000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185671.616244:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898400000:0@lo:400:kworker.0 00010000:00080000:0.0:1789185671.616255:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36efb80 x1876096898400512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185671.616264:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898400512:0@lo:400:kworker.0 00000100:00100000:2.0:1789185671.616471:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898400640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 918us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185671.616479:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1789185671.616512:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3563100 x1876096898400640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185671.616528:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898400640:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789185672.486146:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185673.131135:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898401024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185673.131216:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185673.131407:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898401024 00000100:00100000:0.0:1789185673.131416:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898401024 00000100:00100000:0.0:1789185673.131475:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789185673.131485:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898401024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185673.131520:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185673.131576:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898401024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185673.131600:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789185673.131673:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898401024:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1789185673.315871:0:12612:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185673.318365:0:12612:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789185673.510111:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185674.156555:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185674.156580:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898401152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185674.156662:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185674.156747:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898401152 00000100:00100000:0.0:1789185674.156756:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898401152 00000100:00100000:0.0:1789185674.156830:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789185674.156841:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898401152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185674.156874:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185674.156943:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898401152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185674.156951:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1789185674.156993:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3562680 x1876096898401152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185674.157011:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898401152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789185674.162429:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185674.173568:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898401280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185674.173647:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185674.173726:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898401280 00000100:00100000:1.0:1789185674.173734:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898401280 00000100:00100000:1.0:1789185674.173796:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789185674.173805:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898401280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185674.173827:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185674.173874:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898401280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185674.173882:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789185674.173934:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185674.173973:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f2bda680 x1876096898401280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185674.174006:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898401280:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789185674.556409:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185675.561701:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185676.587185:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185676.648219:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185676.648495:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879445376 00000100:00100000:1.0:1789185676.648510:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879445376 00000100:00100000:1.0:1789185676.648584:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 314 00000100:00100000:1.0:1789185676.648597:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879445376:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185676.648692:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879445376:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 97us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185676.648701:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 314 00000100:00100000:1.0:1789185676.655506:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185676.655648:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879445504 00000100:00100000:3.0:1789185676.655663:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879445504 00000100:00100000:3.0:1789185676.655750:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 181 00000100:00100000:3.0:1789185676.655762:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879445504:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185676.655859:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879445504:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 100us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185676.655868:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 181 00000100:00080000:1.0:1789185676.656645:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185676.665357:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185676.665403:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185676.665447:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185676.665500:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879445632 00000100:00100000:0.0:1789185676.665501:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879445888 00000100:00100000:1.0:1789185676.665514:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879445632 00000100:00100000:0.0:1789185676.665514:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879445888 00000100:00100000:1.0:1789185676.665985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879445760 00000100:00100000:1.0:1789185676.665991:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879445760 00000100:00100000:2.0:1789185676.669962:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 182 00000100:00100000:2.0:1789185676.669985:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879445632:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185676.670060:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 183 00000100:00100000:3.0:1789185676.670072:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879445760:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185676.670132:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879445632:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 154us (4803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.670141:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 182 00000100:00100000:1.0:1789185676.670155:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 184 00000100:00100000:1.0:1789185676.670164:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879445888:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185676.671830:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879445760:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 1746us (6367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185676.671846:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 183 00000100:00080000:3.0:1789185676.671928:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185676.671935:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185676.672283:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879445888:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 2118us (6876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185676.672292:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 184 00000100:00100000:0.0:1789185676.710220:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898401536:0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.710315:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185676.710373:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898402048:0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.710392:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185676.710414:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898402560:0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.710431:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185676.710459:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789185676.710472:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898401664:0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.710499:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185676.710514:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898402176:0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.710530:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185676.710545:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898402688:0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.710564:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185676.710597:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898401536 00000100:00100000:0.0:1789185676.710607:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898401536 00000100:00100000:0.0:1789185676.710656:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898402048 00000100:00100000:0.0:1789185676.710659:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898402048 00000100:00100000:0.0:1789185676.710687:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898402560 00000100:00100000:0.0:1789185676.710690:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898402560 00000100:00100000:0.0:1789185676.710702:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898402176 00000100:00100000:0.0:1789185676.710705:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898402176 00000100:00100000:0.0:1789185676.710719:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898402688 00000100:00100000:0.0:1789185676.710721:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898402688 00000100:00100000:0.0:1789185676.710736:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789185676.710745:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898401536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.710805:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898401536:12345-0@lo:400:kworker.0 Request processed in 60us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185676.710812:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789185676.710832:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789185676.710839:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898402048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.710867:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898402048:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185676.710888:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789185676.710901:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789185676.710936:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898402560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.710976:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898402560:12345-0@lo:400:kworker.0 Request processed in 68us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185676.710982:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789185676.710993:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789185676.710999:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898402176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.711024:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898402176:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185676.711030:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789185676.711040:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789185676.711047:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898402688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.711076:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898402688:12345-0@lo:400:kworker.0 Request processed in 29us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185676.711081:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789185676.711106:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898401664 00000100:00100000:0.0:1789185676.711110:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898401664 00000100:00100000:0.0:1789185676.711138:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789185676.711144:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898401664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.711177:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898401664:12345-0@lo:400:kworker.0 Request processed in 33us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185676.711183:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789185676.711219:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185676.711224:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185676.711261:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898401664:0@lo:400:kworker.0 00010000:00080000:0.0:1789185676.711276:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ec700 x1876096898402176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185676.711300:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898402176:0@lo:400:kworker.0 00010000:00080000:0.0:1789185676.711312:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36eca80 x1876096898402688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185676.711320:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898402688:0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.711330:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898401536:0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.711338:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898402048:0@lo:400:kworker.0 00000100:00100000:0.0:1789185676.711346:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898402560:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.711821:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898401408:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.711883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185676.711940:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898401920:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.711967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185676.711991:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898402432:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712012:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185676.712044:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898402944:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712065:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185676.712086:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789185676.712093:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898401792:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185676.712132:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898402304:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712151:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185676.712167:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898402816:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185676.712392:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898401408 00000100:00100000:2.0:1789185676.712398:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898401408 00000100:00100000:2.0:1789185676.712441:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789185676.712449:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898401408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712498:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898401408:12345-0@lo:400:kworker.0 Request processed in 50us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.712521:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789185676.712558:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898402432 00000100:00100000:2.0:1789185676.712563:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898402432 00000100:00100000:2.0:1789185676.712594:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898402944 00000100:00100000:2.0:1789185676.712597:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898402944 00000100:00100000:2.0:1789185676.712611:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898402304 00000100:00100000:2.0:1789185676.712613:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898402304 00000100:00100000:2.0:1789185676.712627:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898402816 00000100:00100000:2.0:1789185676.712629:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898402816 00000100:00100000:2.0:1789185676.712646:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789185676.712653:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898402432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712690:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898402432:12345-0@lo:400:kworker.0 Request processed in 37us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.712695:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789185676.712706:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185676.712713:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898402944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712741:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898402944:12345-0@lo:400:kworker.0 Request processed in 29us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.712746:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185676.712757:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789185676.712762:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898402304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712787:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898402304:12345-0@lo:400:kworker.0 Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.712792:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789185676.712802:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789185676.712808:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898402816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712848:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898402816:12345-0@lo:400:kworker.0 Request processed in 40us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.712855:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789185676.712888:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185676.712893:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185676.712952:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ef100 x1876096898402304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185676.712966:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898402304:0@lo:400:kworker.0 00010000:00080000:2.0:1789185676.712976:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ed180 x1876096898402816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185676.712984:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898402816:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.712991:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898401408:0@lo:400:kworker.0 00010000:00080000:2.0:1789185676.713000:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ec000 x1876096898402432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185676.713008:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898402432:0@lo:400:kworker.0 00010000:00080000:2.0:1789185676.713113:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36eea00 x1876096898402944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185676.713122:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898402944:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.713162:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898401792 00000100:00100000:2.0:1789185676.713166:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898401792 00000100:00100000:2.0:1789185676.713197:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789185676.713281:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898401792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.713325:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898401792:12345-0@lo:400:kworker.0 Request processed in 121us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.713338:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789185676.713370:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898401792:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.713391:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898403072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185676.713423:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185676.713449:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185676.713455:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898403200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185676.713480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185676.713509:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898403072 00000100:00100000:2.0:1789185676.713513:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898403072 00000100:00100000:2.0:1789185676.713543:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789185676.713550:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898403072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789185676.713581:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185676.713620:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898403072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.713626:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789185676.713644:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898401920 00000100:00100000:2.0:1789185676.713648:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898401920 00000100:00100000:2.0:1789185676.713671:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898403200 00000100:00100000:2.0:1789185676.713673:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898403200 00000100:00100000:2.0:1789185676.713686:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789185676.713692:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898401920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.713733:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898401920:12345-0@lo:400:kworker.0 Request processed in 41us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.713740:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789185676.713751:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789185676.713757:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898403200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185676.713793:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185676.713828:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898403200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185676.713834:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789185676.713867:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898401920:0@lo:400:kworker.0 00000100:00100000:2.0:1789185676.713897:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898403200:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1789185676.713937:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758ca80 x1876096898403072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185676.713950:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898403072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185676.714200:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185676.714391:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898403328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185676.714423:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185676.714485:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898403328 00000100:00100000:1.0:1789185676.714490:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898403328 00000100:00100000:1.0:1789185676.714525:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789185676.714533:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898403328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185676.714558:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185676.714684:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898403328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185676.714692:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789185676.718343:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b2a00 x1876096898403328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185676.718385:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898403328:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1789185676.734306:0:12710:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185676.735089:0:12710:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789185677.606419:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789185677.737402:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000020:00000080:3.0:1789185677.737415:0:8423:0:(genops.c:885:class_export_put()) final put ffff98f1c35c5000/cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000020:00000080:1.0:1789185677.740681:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c35c5000/cc75c41c-3996-44b9-8c8f-b4e6d0f7796c for lustre-OST0000 00000020:00000080:1.0:1789185677.748306:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c35c7000 for lustre-OST0000 00000001:00100000:0.0:1789185677.757077:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000020:00000080:0.0:1789185677.757091:0:9508:0:(genops.c:885:class_export_put()) final put ffff98f1c35c2800/cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000020:00000080:3.0:1789185677.757323:0:497:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c35c2800/cc75c41c-3996-44b9-8c8f-b4e6d0f7796c for lustre-OST0001 00000020:00000080:3.0:1789185677.757391:0:497:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c35c4000 for lustre-OST0001 00000100:00100000:3.0:1789185678.249882:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898403456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185678.250006:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185678.250809:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898403456 00000100:00100000:2.0:1789185678.250827:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898403456 00000100:00100000:2.0:1789185678.250895:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789185678.250930:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898403456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185678.250982:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789185678.251065:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898403456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185678.251073:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789185678.251432:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898403456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185678.631000:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185679.271953:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898403584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185679.272089:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185679.272436:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898403584 00000100:00100000:2.0:1789185679.272449:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898403584 00000100:00100000:2.0:1789185679.272531:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789185679.272543:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898403584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185679.272583:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185679.272669:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898403584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185679.272677:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789185679.274193:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185679.274234:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898403712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185679.274314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789185679.274411:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758c000 x1876096898403584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185679.274438:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898403584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185679.275104:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898403712 00000100:00100000:2.0:1789185679.275118:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898403712 00000100:00100000:2.0:1789185679.275401:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789185679.275414:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898403712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185679.275443:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185679.275518:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898403712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185679.275526:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789185679.275876:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185679.275952:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758ed80 x1876096898403712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185679.275983:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898403712:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1789185679.528458:0:12807:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185679.528737:0:12807:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789185679.656499:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185680.680220:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185681.702245:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185681.770991:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185681.771046:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185681.771076:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185681.771098:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185681.771145:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185681.771174:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879446144 00000100:00100000:3.0:1789185681.771184:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879446144 00000100:00100000:3.0:1789185681.771240:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879446400 00000100:00100000:3.0:1789185681.771243:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879446400 00000100:00100000:3.0:1789185681.771258:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879446272 00000100:00100000:3.0:1789185681.771260:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879446272 00000100:00100000:3.0:1789185681.771269:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879446528 00000100:00100000:3.0:1789185681.771271:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879446528 00000100:00100000:3.0:1789185681.771284:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 191 00000100:00100000:3.0:1789185681.771294:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879446144:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185681.771365:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879446144:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 73us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185681.771373:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 191 00000100:00100000:3.0:1789185681.771389:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 192 00000100:00100000:3.0:1789185681.771395:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879446400:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185681.771417:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879446400:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 22us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185681.771422:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 192 00000100:00100000:3.0:1789185681.771434:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 193 00000100:00100000:3.0:1789185681.771440:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879446272:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185681.771497:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879446272:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 57us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185681.771504:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 193 00000100:00100000:3.0:1789185681.771518:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 194 00000100:00100000:3.0:1789185681.771524:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879446528:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185681.771546:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879446528:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 22us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185681.771551:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 194 00000100:00100000:3.0:1789185681.771570:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879446016 00000100:00100000:3.0:1789185681.771573:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879446016 00000100:00100000:3.0:1789185681.771598:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 316 00000100:00100000:3.0:1789185681.771604:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879446016:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185681.771628:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879446016:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185681.771634:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 316 00000100:00080000:3.0:1789185681.771667:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185681.771671:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185681.833143:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185681.833174:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898403840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185681.833264:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185681.833339:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898403840 00000100:00100000:0.0:1789185681.833347:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898403840 00000100:00100000:0.0:1789185681.833410:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789185681.833420:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898403840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185681.833469:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185681.833520:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898403840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185681.833528:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789185681.833550:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789185681.833583:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b2a00 x1876096898403840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185681.833604:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898403840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185681.834501:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898404096:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.834553:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.834588:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898404608:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.834630:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.834660:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898405120:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.834682:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.834709:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789185681.834715:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898404224:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.834739:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.834759:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898404736:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.834781:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.834799:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898405248:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.834821:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.834854:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898404096 00000100:00100000:1.0:1789185681.834860:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898404096 00000100:00100000:1.0:1789185681.834893:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898404608 00000100:00100000:1.0:1789185681.834895:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898404608 00000100:00100000:1.0:1789185681.834943:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898405120 00000100:00100000:1.0:1789185681.834946:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898405120 00000100:00100000:1.0:1789185681.834957:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898404736 00000100:00100000:1.0:1789185681.834959:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898404736 00000100:00100000:1.0:1789185681.834970:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898405248 00000100:00100000:1.0:1789185681.834973:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898405248 00000100:00100000:1.0:1789185681.834986:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789185681.834994:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898404096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835042:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898404096:12345-0@lo:400:kworker.0 Request processed in 48us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.835049:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789185681.835065:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789185681.835071:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898404608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835122:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898404608:12345-0@lo:400:kworker.0 Request processed in 51us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.835129:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789185681.835142:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789185681.835148:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898405120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835175:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898405120:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.835180:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789185681.835190:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789185681.835195:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898404736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835221:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898404736:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.835226:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789185681.835236:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789185681.835241:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898405248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835264:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898405248:12345-0@lo:400:kworker.0 Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.835270:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789185681.835293:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898404224 00000100:00100000:1.0:1789185681.835296:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898404224 00000100:00100000:1.0:1789185681.835326:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789185681.835332:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898404224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835365:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898404224:12345-0@lo:400:kworker.0 Request processed in 33us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.835371:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1789185681.835402:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185681.835406:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185681.835426:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898404352:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835454:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.835472:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898404864:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.835514:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898405376:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835533:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.835552:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789185681.835559:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898403968:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.835613:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898404480:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835632:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.835649:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898404992:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835667:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185681.835704:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898404864 00000100:00100000:1.0:1789185681.835708:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898404864 00000100:00100000:1.0:1789185681.835740:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898405376 00000100:00100000:1.0:1789185681.835743:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898405376 00000100:00100000:1.0:1789185681.835757:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898404992 00000100:00100000:1.0:1789185681.835760:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898404992 00000100:00100000:1.0:1789185681.835773:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789185681.835781:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898404864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835818:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898404864:12345-0@lo:400:kworker.0 Request processed in 38us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.835824:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789185681.835835:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789185681.835847:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898405376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835877:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898405376:12345-0@lo:400:kworker.0 Request processed in 30us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.835882:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789185681.835892:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789185681.835897:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898404992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.835954:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898404992:12345-0@lo:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.835959:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789185681.835981:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898403968 00000100:00100000:1.0:1789185681.835985:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898403968 00000100:00100000:1.0:1789185681.836010:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789185681.836016:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898403968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.836044:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898403968:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.836049:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789185681.836079:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898404480 00000100:00100000:1.0:1789185681.836082:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898404480 00000100:00100000:1.0:1789185681.836105:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789185681.836124:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898404480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.836153:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898404480:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.836158:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1789185681.836176:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185681.836179:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185681.836207:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898403968:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.836231:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898404480:0@lo:400:kworker.0 00010000:00080000:1.0:1789185681.836241:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3485500 x1876096898404992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185681.836252:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898404992:0@lo:400:kworker.0 00010000:00080000:1.0:1789185681.836261:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3486d80 x1876096898404864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185681.836269:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898404864:0@lo:400:kworker.0 00010000:00080000:1.0:1789185681.836278:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d9a680 x1876096898405376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185681.836286:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898405376:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.836323:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898404224:0@lo:400:kworker.0 00010000:00080000:1.0:1789185681.836332:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3486a00 x1876096898404736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185681.836340:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898404736:0@lo:400:kworker.0 00010000:00080000:1.0:1789185681.836350:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d99500 x1876096898405248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185681.836357:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898405248:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.836369:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898404096:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.836379:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898404608:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.836388:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898405120:0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.836423:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898404352 00000100:00100000:1.0:1789185681.836427:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898404352 00000100:00100000:1.0:1789185681.836452:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789185681.836458:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898404352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185681.836489:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898404352:12345-0@lo:400:kworker.0 Request processed in 32us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185681.836495:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789185681.836520:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898404352:0@lo:400:kworker.0 00000100:00100000:3.0:1789185681.836867:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185681.836879:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898405504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185681.836929:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185681.836962:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898405504 00000100:00100000:3.0:1789185681.836967:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898405504 00000100:00100000:3.0:1789185681.837013:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789185681.837021:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898405504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789185681.837037:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185681.837087:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898405504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185681.837094:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1789185681.837140:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98380 x1876096898405504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185681.837153:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898405504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185681.844688:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898405632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185681.844772:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185681.844871:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898405632 00000100:00100000:3.0:1789185681.844881:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898405632 00000100:00100000:3.0:1789185681.844959:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789185681.844973:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898405632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185681.845018:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789185681.845072:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898405632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185681.845079:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789185681.845145:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898405632:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1789185682.221441:0:12905:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789185682.221792:0:12905:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789185682.727274:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185683.366057:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185683.366103:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898405760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185683.366183:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185683.369134:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898405760 00000100:00100000:0.0:1789185683.369149:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898405760 00000100:00100000:0.0:1789185683.369213:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789185683.369224:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898405760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185683.369266:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185683.369351:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898405760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (3167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185683.369358:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789185683.374403:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898405760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185683.750186:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185684.393333:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185684.393358:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898405888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185684.393435:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185684.393678:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898405888 00000100:00100000:0.0:1789185684.393687:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898405888 00000100:00100000:0.0:1789185684.393760:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789185684.393771:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898405888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185684.393801:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185684.393850:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898405888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185684.393857:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1789185684.393897:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98380 x1876096898405888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185684.393959:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898405888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185684.394633:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185684.394647:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898406016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185684.394688:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185684.394738:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898406016 00000100:00100000:2.0:1789185684.394744:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898406016 00000100:00100000:2.0:1789185684.394792:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789185684.394799:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898406016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185684.394813:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185684.394847:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898406016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185684.394854:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1789185684.394884:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758ed80 x1876096898406016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185684.394899:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898406016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789185684.395880:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185684.774117:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185685.798169:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185686.828283:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185686.897143:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185686.897280:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185686.897337:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879446784 00000100:00100000:1.0:1789185686.897349:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879446784 00000100:00100000:1.0:1789185686.897434:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 201 00000100:00100000:1.0:1789185686.897446:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879446784:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185686.897542:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879446784:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 98us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185686.897550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 201 00000100:00100000:0.0:1789185686.897829:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879446656 00000100:00100000:0.0:1789185686.897834:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879446656 00000100:00100000:0.0:1789185686.897877:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 318 00000100:00100000:0.0:1789185686.897885:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879446656:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185686.897947:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879446656:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 62us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185686.897954:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 318 00000100:00080000:3.0:1789185686.898023:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185686.898518:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185686.898554:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185686.900059:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879446912 00000100:00100000:3.0:1789185686.900096:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879446912 00000100:00080000:0.0:1789185686.900333:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185686.900750:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879447040 00000100:00100000:3.0:1789185686.900756:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879447040 00000100:00100000:3.0:1789185686.900803:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 202 00000100:00100000:3.0:1789185686.900815:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879446912:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185686.901186:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185686.901708:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879446912:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 891us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185686.901719:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 202 00000100:00100000:3.0:1789185686.901748:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879447168 00000100:00100000:3.0:1789185686.901752:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879447168 00000100:00100000:3.0:1789185686.901779:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 203 00000100:00100000:3.0:1789185686.901786:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879447040:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185686.901814:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879447040:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 29us (3261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185686.901820:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 203 00000100:00100000:3.0:1789185686.901830:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 204 00000100:00100000:3.0:1789185686.901835:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879447168:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185686.901853:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879447168:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 19us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185686.901859:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 204 00000100:00080000:3.0:1789185686.901879:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185686.901882:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185686.952673:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898406272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185686.952801:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185686.953097:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898406272 00000100:00100000:2.0:1789185686.953109:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898406272 00000100:00100000:2.0:1789185686.953357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789185686.953370:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898406272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185686.953419:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185686.953484:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898406272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185686.953492:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789185686.953734:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898406272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185686.953943:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898406528:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.953985:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185686.954765:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898406528 00000100:00100000:3.0:1789185686.954773:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898406528 00000100:00100000:3.0:1789185686.954835:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789185686.954844:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898406528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.954948:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898406528:12345-0@lo:400:kworker.0 Request processed in 106us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185686.954956:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789185686.955714:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898407040:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.955784:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185686.955844:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898407552:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.955872:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185686.955946:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898406528:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.955966:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789185686.955975:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898406656:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.955998:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185686.956119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898407040 00000100:00100000:3.0:1789185686.956127:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898407040 00000100:00100000:3.0:1789185686.956400:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898407552 00000100:00100000:3.0:1789185686.956405:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898407552 00000100:00100000:3.0:1789185686.956424:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898406656 00000100:00100000:3.0:1789185686.956427:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898406656 00000100:00100000:3.0:1789185686.956445:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789185686.956455:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898407040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.956513:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898407040:12345-0@lo:400:kworker.0 Request processed in 60us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185686.956793:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898407168:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.956827:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185686.956864:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898407680:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.956886:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789185686.956981:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c37ad180 x1876096898407040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185686.956995:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898407040:0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.957110:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789185686.957145:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789185686.957153:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898407552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.957322:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898407552:12345-0@lo:400:kworker.0 Request processed in 47us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185686.957330:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789185686.957344:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789185686.957350:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898406656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.957383:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898406656:12345-0@lo:400:kworker.0 Request processed in 33us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185686.957389:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1789185686.957422:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185686.957501:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898407168 00000100:00100000:2.0:1789185686.957507:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898407168 00000100:00100000:2.0:1789185686.957734:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898407680 00000100:00100000:2.0:1789185686.957739:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898407680 00000100:00080000:3.0:1789185686.957788:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789185686.957791:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185686.959774:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898406400:0@lo:400:kworker.0 00000100:00100000:0.0:1789185686.960027:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185686.960048:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898407936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185686.960117:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185686.960167:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185686.960203:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898407936 00000100:00100000:0.0:1789185686.960213:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898407936 00000100:00100000:2.0:1789185686.960235:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789185686.960254:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898407168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185686.960281:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789185686.960290:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898407936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185686.960322:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185686.960365:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898407936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185686.960372:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789185686.960401:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898406912:0@lo:400:kworker.0 00010000:00080000:0.0:1789185686.960421:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d99500 x1876096898407936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185686.960443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185686.960465:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898407936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185686.960472:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898407424:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.962346:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898407168:12345-0@lo:400:kworker.0 Request processed in 2088us (5507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185686.962366:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789185686.962428:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789185686.962446:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898407680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.962632:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898407680:12345-0@lo:400:kworker.0 Request processed in 194us (5744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185686.962638:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789185686.962856:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898406400 00000100:00100000:2.0:1789185686.962867:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898406400 00000100:00100000:2.0:1789185686.962938:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789185686.962946:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898406400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.962986:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898406400:12345-0@lo:400:kworker.0 Request processed in 42us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185686.962992:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789185686.963051:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898406784:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.963093:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185686.963139:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898407296:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.963166:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185686.963183:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898407808:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.963209:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185686.963442:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185686.963473:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898406144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185686.963509:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185686.963606:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898406400:0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.963643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898406912 00000100:00100000:3.0:1789185686.963648:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898406912 00000100:00100000:3.0:1789185686.963691:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898407424 00000100:00100000:3.0:1789185686.963695:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898407424 00000100:00100000:3.0:1789185686.963726:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789185686.963735:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898406912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.963789:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898406912:12345-0@lo:400:kworker.0 Request processed in 54us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185686.963796:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789185686.963811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789185686.963818:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898407424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.964093:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898407424:12345-0@lo:400:kworker.0 Request processed in 274us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185686.964100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789185686.964126:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898406784 00000100:00100000:3.0:1789185686.964130:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898406784 00000100:00100000:1.0:1789185686.964150:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898407296 00000100:00100000:1.0:1789185686.964157:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898407296 00000100:00100000:3.0:1789185686.964298:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789185686.964313:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898406784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185686.964386:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898407808 00000100:00100000:3.0:1789185686.964392:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898406784:12345-0@lo:400:kworker.0 Request processed in 78us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185686.964392:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898407808 00000100:00100000:3.0:1789185686.964402:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789185686.964420:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898406784:0@lo:400:kworker.0 00000100:00100000:1.0:1789185686.964428:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789185686.964438:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898406656:0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.964440:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898406144 00000100:00100000:1.0:1789185686.964440:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898407296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.964447:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898406144 00010000:00080000:2.0:1789185686.964469:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758ed80 x1876096898407168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185686.964483:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898407168:0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.964487:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789185686.964488:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898407296:12345-0@lo:400:kworker.0 Request processed in 52us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185686.964498:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789185686.964502:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898406144:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789185686.964508:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d2300 x1876096898407680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185686.964518:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898407680:0@lo:400:kworker.0 00000100:00100000:1.0:1789185686.964525:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789185686.964533:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898407808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185686.964562:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898407808:12345-0@lo:400:kworker.0 Request processed in 32us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185686.964566:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00002000:00000024:3.0:1789185686.964611:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1789185686.964637:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d2680 x1876096898407552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185686.964648:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898407552:0@lo:400:kworker.0 00000100:00100000:3.0:1789185686.964661:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898406144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185686.964670:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1789185686.964681:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d2a00 x1876096898407296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185686.964695:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898407296:0@lo:400:kworker.0 00000100:00080000:3.0:1789185686.964712:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185686.964713:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d0000 x1876096898407808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789185686.964720:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185686.964726:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185686.964727:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898407808:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.964760:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898406912:0@lo:400:kworker.0 00000100:00100000:2.0:1789185686.964773:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898407424:0@lo:400:kworker.0 00010000:00080000:2.0:1789185686.964784:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98380 x1876096898406144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185686.964800:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898406144:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1789185687.133790:0:13049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789185687.849177:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185688.486263:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185688.486296:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898408064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185688.486419:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185688.486583:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898408064 00000100:00100000:0.0:1789185688.486596:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898408064 00000100:00100000:0.0:1789185688.486665:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789185688.486687:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898408064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185688.486736:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185688.486803:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898408064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185688.486810:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789185688.486852:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898408064:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789185688.871091:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185689.511185:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185689.511356:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898408192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185689.511471:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185689.511562:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898408192 00000100:00100000:2.0:1789185689.511573:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898408192 00000100:00100000:2.0:1789185689.513641:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789185689.513666:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898408192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185689.513714:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185689.514053:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185689.514073:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898408320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185689.524167:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185689.524852:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898408320 00000100:00100000:1.0:1789185689.524869:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898408320 00000100:00100000:1.0:1789185689.524956:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789185689.524982:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898408320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185689.525017:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185689.525097:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898408320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185689.525104:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789185689.525459:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33edf80 x1876096898408320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185689.525489:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898408320:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789185689.525994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185689.534300:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898408192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 20636us (22820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185689.534318:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1789185689.536953:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c2302a00 x1876096898408192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185689.537001:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898408192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185689.895550:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185690.918730:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185691.943241:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185692.006228:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185692.006283:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185692.006320:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185692.006345:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185692.006372:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185692.006511:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879447296 00000100:00100000:1.0:1789185692.006525:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879447296 00000100:00100000:1.0:1789185692.006598:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 320 00000100:00100000:1.0:1789185692.006610:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879447296:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185692.006727:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879447296:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 119us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185692.006735:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 320 00000100:00100000:2.0:1789185692.007160:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879447552 00000100:00100000:2.0:1789185692.007169:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879447552 00000100:00100000:2.0:1789185692.007230:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879447808 00000100:00100000:2.0:1789185692.007233:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879447808 00000100:00100000:2.0:1789185692.007249:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879447424 00000100:00100000:2.0:1789185692.007251:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879447424 00000100:00100000:2.0:1789185692.007262:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879447680 00000100:00100000:2.0:1789185692.007264:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879447680 00000100:00100000:2.0:1789185692.007281:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 211 00000100:00100000:2.0:1789185692.007290:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879447552:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185692.007346:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879447552:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 57us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.007353:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 211 00000100:00100000:2.0:1789185692.007368:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 212 00000100:00100000:2.0:1789185692.007385:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879447808:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185692.007427:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879447808:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 43us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.007434:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 212 00000100:00100000:2.0:1789185692.007447:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 213 00000100:00100000:2.0:1789185692.007453:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879447424:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185692.007476:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879447424:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 23us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.007482:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 213 00000100:00100000:2.0:1789185692.007492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 214 00000100:00100000:2.0:1789185692.007499:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879447680:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185692.007522:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879447680:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.007528:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 214 00000100:00080000:1.0:1789185692.007783:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185692.007789:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1789185692.016159:0:13197:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd399bfc0 20000000:00000080:0.0:1789185692.016182:0:13197:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f1c3596800 uarg=0000000000000000 20000000:01000000:0.0:1789185692.016240:0:13197:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789185692.016248:0:13197:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789185692.016255:0:13197:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789185692.018045:0:13198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789185692.018831:0:13197:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789185692.027261:0:13197:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789185692.027338:0:13197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027364:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e3b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027371:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e49 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027378:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e57 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027384:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72e65 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027395:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d06 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027403:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d45 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027411:0:13197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027480:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d45 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027502:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d45 expref: 12 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185692.027521:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408448:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185692.027682:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d06 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027691:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d06 expref: 12 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185692.027699:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408576:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185692.027729:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72e65 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027737:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72e65 expref: 23 pid: 6505 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185692.027746:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408704:0@lo:104: 00000100:00100000:0.0:1789185692.027797:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185692.027836:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72e57 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027844:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72e57 expref: 23 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185692.027852:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408832:0@lo:104: 00000100:00100000:0.0:1789185692.027876:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185692.027955:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72e49 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.027963:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72e49 expref: 23 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185692.027972:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408960:0@lo:104: 00000100:00100000:0.0:1789185692.028006:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185692.028029:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72e3b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.028036:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72e3b expref: 23 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185692.028042:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898409088:0@lo:104: 00000100:00100000:0.0:1789185692.028059:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185692.028068:0:13197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7fcc300 going to sleep for 11 seconds 00000100:00100000:2.0:1789185692.028292:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898408704 00000100:00100000:2.0:1789185692.028303:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898408704 00000100:00100000:2.0:1789185692.028358:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898408832 00000100:00100000:2.0:1789185692.028361:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898408832 00000100:00100000:2.0:1789185692.028371:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898408960 00000100:00100000:2.0:1789185692.028373:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898408960 00000100:00100000:2.0:1789185692.028382:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898409088 00000100:00100000:2.0:1789185692.028385:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898409088 00000100:00100000:2.0:1789185692.028413:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789185692.028424:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+6:13197:x1876096898408704:12345-0@lo:104: 00010000:00010000:2.0:1789185692.028440:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185692.028799:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185692.028807:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+6:13197:x1876096898408704:12345-0@lo:104: Request processed in 385us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.028815:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789185692.028841:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789185692.028860:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+5:13197:x1876096898408832:12345-0@lo:104: 00010000:00010000:2.0:1789185692.028869:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185692.033022:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408704:0@lo:104: 00000100:00100000:0.0:1789185692.033043:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408832:0@lo:104: 00010000:00010000:3.0:1789185692.033230:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185692.033243:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033256:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185692.033262:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033273:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185692.033282:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185692.033288:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185692.033354:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033362:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185692.033388:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033396:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300dde000/0xda5c730d5a72e65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033410:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185692.033414:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033420:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185692.033443:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033451:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185692.033457:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185692.033461:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185692.033478:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033484:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185692.033491:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033497:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300ddf000/0xda5c730d5a72e57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.033508:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185692.033509:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185692.033511:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185692.033532:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898409344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185692.033628:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185692.033698:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185692.033705:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898409216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185692.033726:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185692.033748:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185692.033761:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898409344 00000100:00100000:3.0:1789185692.033770:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898409344 00000100:00100000:0.0:1789185692.033786:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408448:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185692.033820:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72e57 expref: 24 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185692.033864:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898409216 00000100:00100000:3.0:1789185692.033868:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898409216 00010000:00010000:3.0:1789185692.033882:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72e65 expref: 25 pid: 6505 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185692.033897:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879447936 00000100:00100000:3.0:1789185692.033902:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879447936 00000100:00100000:0.0:1789185692.034491:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789185692.034508:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9010c27d-11d2-44c0-a2e4-e8975764c875+25:3638:x1876096898409344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185692.034525:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185692.034532:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72e57 expref: 25 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.034545:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72e57 expref: 25 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.034565:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166da00/0xda5c730d5a72e5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72e57 expref: 25 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.034597:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185692.034663:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898409344:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185692.034682:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789185692.034711:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185692.034719:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3638:x1876096898409216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185692.034727:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185692.034732:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72e65 expref: 23 pid: 6505 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.034741:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72e65 expref: 23 pid: 6505 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.034755:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddf600/0xda5c730d5a72e6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72e65 expref: 23 pid: 6505 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.034764:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185692.034787:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3638:x1876096898409216:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185692.034793:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789185692.038132:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d45 expref: 13 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185692.038220:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:3.0:1789185692.038245:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879447936:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185692.038272:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185692.038282:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d45 expref: 13 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.038296:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d45 expref: 13 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.038321:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0030800/0xda5c730d5a72e88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d45 expref: 13 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.038338:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185692.038430:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:2392:x1876096879447936:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 198us (4682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185692.038441:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:3.0:1789185692.038524:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898409216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185692.038558:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898409344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185692.038657:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789185692.038668:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+5:13197:x1876096898408832:12345-0@lo:104: Request processed in 9819us (10789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.038678:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789185692.038703:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789185692.038712:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:13197:x1876096898408960:12345-0@lo:104: 00010000:00010000:2.0:1789185692.038726:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185692.038808:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789185692.038814:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:13197:x1876096898408960:12345-0@lo:104: Request processed in 105us (10809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.038819:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789185692.038831:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789185692.038838:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:13197:x1876096898409088:12345-0@lo:104: 00010000:00010000:2.0:1789185692.038861:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185692.038902:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789185692.038936:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:13197:x1876096898409088:12345-0@lo:104: Request processed in 71us (10847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.038943:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789185692.039238:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185692.039246:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.039254:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185692.039259:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.039267:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185692.039274:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185692.039279:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789185692.039523:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185692.039529:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185692.039536:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:1.0:1789185692.039538:0:9518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185692.039545:0:9518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185692.039550:0:9518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185692.039556:0:9518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185692.039613:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.039620:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185692.039647:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.039653:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a72e49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.039668:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185692.039670:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185692.039672:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185692.039969:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898409472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185692.040042:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185692.040107:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898409472 00000100:00100000:3.0:1789185692.040116:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898409472 00000100:00100000:0.0:1789185692.040385:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408960:0@lo:104: 00000100:00100000:0.0:1789185692.040397:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898409088:0@lo:104: 00010000:00010000:3.0:1789185692.040763:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72e49 expref: 22 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185692.040801:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185692.040811:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3635:x1876096898409472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185692.040833:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185692.040840:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72e49 expref: 22 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.040863:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72e49 expref: 22 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.040885:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddfa00/0xda5c730d5a72e50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72e49 expref: 22 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.040901:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185692.040990:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3635:x1876096898409472:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185692.040998:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185692.041033:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898409472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185692.041470:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1876096898408576:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185692.041546:0:13197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185692.041899:0:9518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185692.041941:0:9518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185692.041963:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185692.041991:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031000/0xda5c730d5a72e3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72e42 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185692.042013:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185692.042015:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185692.042017:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185692.042027:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185692.042045:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898409600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185692.042115:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185692.042179:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898409600 00000100:00100000:1.0:1789185692.042186:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898409600 00010000:00010000:1.0:1789185692.042216:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72e3b expref: 21 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185692.042249:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185692.042259:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3636:x1876096898409600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185692.042273:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185692.042278:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72e3b expref: 21 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185692.042289:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72e3b expref: 21 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185692.042303:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72e42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72e3b expref: 21 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185692.042316:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185692.042351:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:3636:x1876096898409600:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185692.042366:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185692.042399:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898409600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185692.044799:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185692.044905:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879448064 00000100:00100000:3.0:1789185692.044987:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879448064 00010000:00010000:3.0:1789185692.045041:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d06 expref: 12 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185692.045094:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 45 00000100:00100000:3.0:1789185692.045105:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:2391:x1876096879448064:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185692.045125:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185692.045131:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d06 expref: 12 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045146:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d06 expref: 12 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045170:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a72e73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d06 expref: 12 pid: 6506 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045192:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045215:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045235:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045244:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045252:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045271:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045278:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031e00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185692.045283:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045293:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045324:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185692.045337:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185692.045353:0:13197:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.045367:0:13197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185692.045376:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031e00/0xda5c730d5a72eab lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185692.045426:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:2391:x1876096879448064:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 321us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185692.045438:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 45 00000100:00100000:0.0:1789185692.071135:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898409728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185692.071252:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.071650:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898409856:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.071697:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.071722:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898410368:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.071746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.071765:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898410880:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.071786:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.071806:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789185692.071812:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898410240:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.071836:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.071853:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898410752:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.071876:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.071892:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898411264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185692.071943:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.071968:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898409984:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.071988:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.072006:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898410496:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.072027:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.072043:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898411008:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.072062:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.072094:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789185692.072099:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898410112:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.072119:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.072130:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898410624:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.072148:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.072163:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898411136:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.072199:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185692.072238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898409856 00000100:00100000:2.0:1789185692.072248:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898409856 00000100:00100000:2.0:1789185692.072297:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898410368 00000100:00100000:2.0:1789185692.072300:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898410368 00000100:00100000:2.0:1789185692.072903:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898410880 00000100:00100000:2.0:1789185692.072944:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898410880 00000100:00100000:2.0:1789185692.072966:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898410496 00000100:00100000:2.0:1789185692.072969:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898410496 00000100:00100000:2.0:1789185692.072982:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898411008 00000100:00100000:2.0:1789185692.072985:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898411008 00000100:00100000:2.0:1789185692.072997:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898410112 00000100:00100000:2.0:1789185692.072999:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898410112 00000100:00100000:2.0:1789185692.073015:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789185692.073024:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898409856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.073103:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898409856:12345-0@lo:400:kworker.0 Request processed in 79us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.073111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789185692.073131:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789185692.073137:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898410368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185692.073356:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898410240 00000100:00100000:0.0:1789185692.073360:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898410240 00000100:00100000:0.0:1789185692.073384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898411264 00000100:00100000:0.0:1789185692.073387:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898411264 00000100:00100000:0.0:1789185692.073398:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898409984 00000100:00100000:0.0:1789185692.073400:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898409984 00000100:00100000:0.0:1789185692.073411:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789185692.073417:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898410240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185692.073468:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898410240:12345-0@lo:400:kworker.0 Request processed in 51us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185692.073474:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789185692.073505:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789185692.073511:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1876096898411264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185692.073538:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789185692.073573:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1876096898411264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185692.073579:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789185692.073606:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789185692.073622:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898409984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185692.073658:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898409984:12345-0@lo:400:kworker.0 Request processed in 46us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185692.073663:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789185692.073686:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185692.073710:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898411392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185692.073750:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185692.073784:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898409728 00000100:00100000:0.0:1789185692.073788:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898409728 00000100:00100000:0.0:1789185692.073814:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898411392 00000100:00100000:0.0:1789185692.073817:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898411392 00000100:00100000:0.0:1789185692.073831:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789185692.073836:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898409728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185692.073858:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185692.074904:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898410368:12345-0@lo:400:kworker.0 Request processed in 1758us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.074946:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789185692.074999:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789185692.075011:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898410880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.075060:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898410880:12345-0@lo:400:kworker.0 Request processed in 54us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.075067:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789185692.075079:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789185692.075087:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898410496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.075117:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898410496:12345-0@lo:400:kworker.0 Request processed in 32us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.075123:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789185692.075136:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789185692.075142:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898411008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.075172:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898411008:12345-0@lo:400:kworker.0 Request processed in 31us (3109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.075178:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789185692.075189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789185692.075326:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898409728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1487us (4073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185692.075335:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789185692.075372:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789185692.075380:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898411392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789185692.075396:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185692.075759:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898410752 00000100:00100000:1.0:1789185692.075769:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898410752 00000100:00100000:1.0:1789185692.075946:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898410624 00000100:00100000:1.0:1789185692.076089:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898410624 00000100:00100000:1.0:1789185692.076112:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898411136 00000100:00100000:1.0:1789185692.076115:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898411136 00000100:00100000:1.0:1789185692.076128:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789185692.076136:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898410752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185692.076189:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898410752:12345-0@lo:400:kworker.0 Request processed in 54us (4311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185692.076196:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789185692.076208:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789185692.076213:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898410624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185692.076237:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898410624:12345-0@lo:400:kworker.0 Request processed in 24us (4088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185692.076242:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789185692.076251:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789185692.076256:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3635:x1876096898411136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185692.076278:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3635:x1876096898411136:12345-0@lo:400:kworker.0 Request processed in 22us (4079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185692.076283:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789185692.076303:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185692.076307:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185692.076311:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185692.076321:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185692.076413:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898411392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185692.076422:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1789185692.076582:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d2a00 x1876096898410624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185692.076602:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898410624:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.077413:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898410112:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789185692.077536:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c37ad880 x1876096898411136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185692.077550:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898411136:0@lo:400:kworker.0 00000100:00100000:0.0:1789185692.077565:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898409984:0@lo:400:kworker.0 00010000:00080000:0.0:1789185692.077589:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d0000 x1876096898410496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185692.077596:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898410496:0@lo:400:kworker.0 00010000:00080000:0.0:1789185692.077608:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758ed80 x1876096898411008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185692.077791:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898410112:12345-0@lo:400:kworker.0 Request processed in 394us (5670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185692.077800:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789185692.077955:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898410240:0@lo:400:kworker.0 00010000:00080000:2.0:1789185692.077969:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d2680 x1876096898410752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185692.077978:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898410752:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.078010:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898411264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185692.078024:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898409856:0@lo:400:kworker.0 00000100:00100000:2.0:1789185692.078034:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898410368:0@lo:400:kworker.0 00000100:00100000:0.0:1789185692.078947:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898411008:0@lo:400:kworker.0 00000100:00100000:0.0:1789185692.079012:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898410112:0@lo:400:kworker.0 00010000:00080000:0.0:1789185692.079078:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3560000 x1876096898411392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185692.079096:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898411392:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789185692.079115:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33fa680 x1876096898409728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185692.079126:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898409728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185692.079774:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898410880:0@lo:400:kworker.0 00010000:00010000:3.0:1789185692.966345:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185693.612520:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185693.612553:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898411520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185693.612651:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.612739:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898411520 00000100:00100000:3.0:1789185693.612749:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898411520 00000100:00100000:3.0:1789185693.612812:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789185693.612824:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898411520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185693.612878:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789185693.613239:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898411520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 414us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.613266:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789185693.613370:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898411520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185693.927502:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185693.927613:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879448192 00000100:00100000:1.0:1789185693.927629:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879448192 00000100:00100000:1.0:1789185693.927700:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 321 00000100:00100000:1.0:1789185693.927714:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:6163:x1876096879448192:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185693.927739:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185693.927765:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d76 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185693.927809:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d76 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185693.927822:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d76 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185693.927832:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8800, rc 0) 00000100:00100000:1.0:1789185693.927957:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879448192:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 Request processed in 245us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185693.927966:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 321 00000100:00100000:1.0:1789185693.932441:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185693.933082:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879448320 00000100:00100000:3.0:1789185693.933098:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879448320 00000100:00100000:3.0:1789185693.933173:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 322 00000100:00100000:3.0:1789185693.933186:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879448320:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.933416:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879448320:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 Request processed in 231us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.933426:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 322 10000000:01000000:2.0:1789185693.934480:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185693.934488:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2ff976000 from 7 10000000:01000000:2.0:1789185693.934494:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185693.934556:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185693.934573:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185693.934586:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185693.934616:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898411648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185693.934693:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185693.934746:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.934992:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898411648 00000100:00100000:3.0:1789185693.935001:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898411648 00000100:00100000:3.0:1789185693.935053:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789185693.935064:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898411648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185693.935079:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185693.935096:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72eb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.935126:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72eb9 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.935138:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72eb9 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.935147:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166c800, rc 0) 00000100:00100000:3.0:1789185693.935198:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898411648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.935204:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789185693.935267:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898411648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185693.935284:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.935294:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185693.935377:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898411776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.935407:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.935423:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.935436:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898411776 00000100:00100000:3.0:1789185693.935440:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898411776 00000100:00100000:3.0:1789185693.935463:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789185693.935469:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898411776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.935586:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898411776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.935593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789185693.935742:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898411776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.935776:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898411904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.935824:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.935838:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.935849:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898411904 00000100:00100000:3.0:1789185693.935852:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898411904 00000100:00100000:3.0:1789185693.935875:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789185693.935905:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898411904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.936029:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898411904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.936043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789185693.936086:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898411904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789185693.936839:0:13230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789185693.936995:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789185693.937021:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185693.937032:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.937045:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185693.937056:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185693.937059:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2d26ca000 from 7 10000000:01000000:3.0:1789185693.937062:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185693.937099:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.937108:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.937119:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185693.937140:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.937190:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.937213:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.937233:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898412032 00000100:00100000:3.0:1789185693.937239:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898412032 00000100:00100000:3.0:1789185693.937277:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789185693.937300:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898412032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185693.937313:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185693.937328:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72ec7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.937352:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72ec7 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.937364:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ec7 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.937374:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166c000, rc 0) 00000100:00100000:3.0:1789185693.937411:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898412032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.937417:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789185693.937462:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185693.937474:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.937483:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185693.937537:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.937563:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.937577:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.937590:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898412160 00000100:00100000:3.0:1789185693.937593:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898412160 00000100:00100000:3.0:1789185693.937614:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789185693.937627:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898412160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.937736:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898412160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.937744:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789185693.937774:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.937800:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.949348:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.949414:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185693.949512:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185693.949577:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898412288 00000100:00100000:0.0:1789185693.949590:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898412288 00000100:00100000:0.0:1789185693.949657:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879448448 00000100:00100000:0.0:1789185693.949661:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879448448 00000100:00100000:0.0:1789185693.949681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789185693.949692:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898412288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185693.949933:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898412288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185693.949942:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789185693.950000:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 329 00000100:00100000:0.0:1789185693.950012:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879448448:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185693.950080:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879448448:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 Request processed in 68us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185693.950087:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 329 00000100:00100000:3.0:1789185693.950654:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789185693.954480:0:13231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789185693.954849:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789185693.954943:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789185693.954959:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185693.954974:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185693.954988:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789185693.954991:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f30030e800 from 7 10000000:01000000:0.0:1789185693.954995:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185693.955052:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185693.955061:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185693.955075:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185693.955109:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3560000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185693.955213:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185693.955267:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c12ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.955525:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898412416 00000100:00100000:3.0:1789185693.955535:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898412416 00000100:00100000:3.0:1789185693.955592:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789185693.955602:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898412416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185693.955621:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185693.955638:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72ed5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.955669:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72ed5 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.955682:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ed5 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.955693:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166d600, rc 0) 00000100:00100000:3.0:1789185693.955750:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898412416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.955776:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789185693.955835:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3560000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185693.955857:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.955868:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185693.956338:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.956374:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.956403:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.956421:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898412544 00000100:00100000:3.0:1789185693.956426:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898412544 00000100:00100000:3.0:1789185693.956456:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789185693.956464:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898412544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.956599:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898412544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.956607:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789185693.956644:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.956673:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.956724:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.956739:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.956752:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898412672 00000100:00100000:3.0:1789185693.956756:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898412672 00000100:00100000:3.0:1789185693.956777:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789185693.956789:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898412672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.960557:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898412672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.960591:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789185693.960733:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789185693.968236:0:13232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789185693.977459:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789185693.977514:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185693.977530:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.977547:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185693.977674:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185693.977678:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2e7ae1000 from 7 10000000:01000000:3.0:1789185693.977682:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185693.977733:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.977742:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.977755:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185693.977790:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.977889:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.977960:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185693.978147:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185693.983611:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898412800 00000100:00100000:3.0:1789185693.983665:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898412800 00000100:00100000:3.0:1789185693.983739:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879448576 00000100:00100000:3.0:1789185693.983743:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879448576 00000100:00100000:3.0:1789185693.983765:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789185693.983777:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898412800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185693.983801:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185693.983828:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a72ee3 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.983869:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a72ee3 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.983895:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ee3 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.983926:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c13a2000, rc 0) 00000100:00100000:3.0:1789185693.984029:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898412800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (6153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.984037:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789185693.984079:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 334 00000100:00100000:3.0:1789185693.984086:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879448576:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185693.984093:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185693.984102:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d7d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.984116:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d7d expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.984124:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d7d expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.984138:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185693.984322:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879448576:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 Request processed in 234us (6175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.984328:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 334 00000100:00100000:3.0:1789185693.984527:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185693.984552:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.984564:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185693.984676:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.984726:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185693.984754:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898412928 00000100:00100000:3.0:1789185693.984759:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898412928 00000100:00100000:3.0:1789185693.984784:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789185693.984789:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898412928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.984998:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898412928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185693.985005:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789185693.985045:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.985057:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898412928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.985087:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898413056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185693.985138:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185693.985339:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898413056 00000100:00100000:0.0:1789185693.985352:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898413056 00000100:00100000:0.0:1789185693.985384:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789185693.985391:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898413056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185693.985488:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898413056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185693.985495:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789185693.991991:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185693.992064:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898413056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789185693.995721:0:13236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789185693.995814:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789185693.995841:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185693.995857:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185693.995872:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185693.996817:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185694.004436:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185694.004498:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879448704 00000100:00100000:0.0:1789185694.004513:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879448704 00000100:00100000:0.0:1789185694.004586:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 337 00000100:00100000:0.0:1789185694.004599:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879448704:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185694.004807:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879448704:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 Request processed in 210us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185694.004816:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 337 00000100:00100000:0.0:1789185694.011085:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185694.021184:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879448832 00000100:00100000:3.0:1789185694.021212:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879448832 00000100:00100000:3.0:1789185694.024985:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 338 00000100:00100000:3.0:1789185694.025136:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879448832:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185694.025407:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879448832:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 Request processed in 403us (14339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185694.025417:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 338 00000100:00100000:1.0:1789185694.630272:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185694.630299:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898413184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185694.630382:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185694.630543:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898413184 00000100:00100000:3.0:1789185694.630552:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898413184 00000100:00100000:3.0:1789185694.630611:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789185694.630621:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898413184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789185694.630652:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185694.630699:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898413184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185694.630706:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1789185694.630750:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33f8380 x1876096898413184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185694.630771:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898413184:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789185694.630830:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185694.630983:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185694.630993:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898413312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185694.631020:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185694.631045:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898413312 00000100:00100000:1.0:1789185694.631051:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898413312 00000100:00100000:1.0:1789185694.631077:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789185694.631082:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898413312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185694.631092:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185694.631119:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898413312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185694.631125:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789185694.631139:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185694.631154:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e1500 x1876096898413312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185694.631167:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898413312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185695.017383:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185696.039509:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185697.066518:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185697.127741:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185697.127786:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185697.127841:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185697.127867:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185697.127891:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185697.127954:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879448960 00000100:00100000:0.0:1789185697.127964:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879448960 00000100:00100000:0.0:1789185697.128016:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 339 00000100:00100000:0.0:1789185697.128027:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879448960:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185697.128125:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879448960:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185697.128148:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 339 00000100:00100000:0.0:1789185697.128188:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879449088 00000100:00100000:0.0:1789185697.128192:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879449088 00000100:00100000:0.0:1789185697.128230:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879449344 00000100:00100000:0.0:1789185697.128233:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879449344 00000100:00100000:0.0:1789185697.128247:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879449216 00000100:00100000:0.0:1789185697.128250:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879449216 00000100:00100000:0.0:1789185697.128261:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879449472 00000100:00100000:0.0:1789185697.128264:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879449472 00000100:00100000:0.0:1789185697.128278:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 221 00000100:00100000:0.0:1789185697.128284:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879449088:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185697.128315:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879449088:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185697.128321:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 221 00000100:00100000:0.0:1789185697.128333:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 222 00000100:00100000:0.0:1789185697.128339:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879449344:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185697.128361:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879449344:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 22us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185697.128367:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 222 00000100:00100000:0.0:1789185697.128377:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 223 00000100:00100000:0.0:1789185697.128383:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879449216:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185697.128404:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879449216:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 21us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185697.128410:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 223 00000100:00100000:0.0:1789185697.128421:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 224 00000100:00100000:0.0:1789185697.128434:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879449472:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185697.128460:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879449472:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 28us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185697.128466:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 224 00000100:00080000:0.0:1789185697.128606:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185697.128610:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185697.194239:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185697.194262:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898413440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185697.194350:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185697.194424:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898413440 00000100:00100000:2.0:1789185697.194440:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898413440 00000100:00100000:2.0:1789185697.194493:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789185697.194504:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898413440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185697.194541:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185697.194592:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898413440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185697.194600:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789185697.195294:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898413568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185697.195336:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185697.195372:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185697.195377:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898413696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185697.195398:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185697.195432:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898413568 00000100:00100000:0.0:1789185697.195436:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898413568 00000100:00100000:0.0:1789185697.195479:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898413696 00000100:00100000:0.0:1789185697.195482:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898413696 00000100:00100000:0.0:1789185697.195497:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789185697.195503:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898413568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185697.195525:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185697.195561:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898413568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185697.195568:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789185697.195584:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789185697.195589:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898413696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789185697.195597:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185697.195615:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898413696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185697.195637:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789185697.195653:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789185697.195683:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c37afb80 x1876096898413696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185697.195699:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898413696:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789185697.195708:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c2303480 x1876096898413568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185697.195717:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898413568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185697.196983:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898413952:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197039:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.197077:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898414464:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197097:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.197124:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898414976:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197147:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.197173:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789185697.197179:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898413824:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197208:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.197236:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898414336:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.197274:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898414848:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197294:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.197321:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898413952 00000100:00100000:1.0:1789185697.197328:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898413952 00000100:00100000:1.0:1789185697.197359:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898414464 00000100:00100000:1.0:1789185697.197362:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898414464 00000100:00100000:1.0:1789185697.197386:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898414976 00000100:00100000:1.0:1789185697.197389:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898414976 00000100:00100000:1.0:1789185697.197402:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898414336 00000100:00100000:1.0:1789185697.197404:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898414336 00000100:00100000:1.0:1789185697.197416:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898414848 00000100:00100000:1.0:1789185697.197418:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898414848 00000100:00100000:1.0:1789185697.197432:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789185697.197440:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898413952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197487:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898413952:12345-0@lo:400:kworker.0 Request processed in 47us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.197494:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789185697.197510:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789185697.197516:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898414464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197543:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898414464:12345-0@lo:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.197559:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789185697.197572:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789185697.197578:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898414976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197606:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898414976:12345-0@lo:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.197612:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789185697.197623:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789185697.197628:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898414336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197656:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898414336:12345-0@lo:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.197661:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789185697.197672:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789185697.197677:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898414848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197701:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898414848:12345-0@lo:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.197707:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789185697.197731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898413824 00000100:00100000:1.0:1789185697.197735:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898413824 00000100:00100000:1.0:1789185697.197761:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789185697.197767:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898413824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197797:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898413824:12345-0@lo:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.197803:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789185697.197861:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898413824:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197884:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898414336:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197893:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898414848:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.197902:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898413952:0@lo:400:kworker.0 00010000:00080000:1.0:1789185697.197938:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3487b80 x1876096898414464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185697.197948:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898414464:0@lo:400:kworker.0 00010000:00080000:1.0:1789185697.197956:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3486a00 x1876096898414976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185697.197965:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898414976:0@lo:400:kworker.0 00000100:00080000:1.0:1789185697.197999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185697.198003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185697.198012:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898414080:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.198039:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.198058:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898414592:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.198082:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.198102:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789185697.198108:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898414208:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.198130:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.198148:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898414720:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.198167:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185697.198191:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898414080 00000100:00100000:1.0:1789185697.198196:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898414080 00000100:00100000:1.0:1789185697.198220:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789185697.198235:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898414080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.198270:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898414080:12345-0@lo:400:kworker.0 Request processed in 36us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.198276:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789185697.198296:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898414592 00000100:00100000:1.0:1789185697.198299:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898414592 00000100:00100000:1.0:1789185697.198331:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898414720 00000100:00100000:1.0:1789185697.198333:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898414720 00000100:00100000:1.0:1789185697.198351:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789185697.198356:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898414592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.198386:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898414592:12345-0@lo:400:kworker.0 Request processed in 30us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.198391:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789185697.198402:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789185697.198407:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898414720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.198434:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898414720:12345-0@lo:400:kworker.0 Request processed in 26us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.198440:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789185697.198456:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898414208 00000100:00100000:1.0:1789185697.198460:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898414208 00000100:00100000:1.0:1789185697.198483:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789185697.198489:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898414208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.198520:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898414208:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185697.198525:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1789185697.198547:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185697.198565:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898414208:0@lo:400:kworker.0 00010000:00080000:1.0:1789185697.198582:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3484380 x1876096898414720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185697.198591:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898414720:0@lo:400:kworker.0 00000100:00100000:1.0:1789185697.198599:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898414080:0@lo:400:kworker.0 00010000:00080000:1.0:1789185697.198607:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c3485f80 x1876096898414592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185697.198615:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898414592:0@lo:400:kworker.0 00000100:00100000:2.0:1789185697.199139:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898413440:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1789185697.371581:0:13396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789185698.086320:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185698.730178:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185698.730213:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898415104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185698.730303:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185698.730441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898415104 00000100:00100000:3.0:1789185698.730466:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898415104 00000100:00100000:3.0:1789185698.730563:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789185698.730576:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898415104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185698.730654:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789185698.730752:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898415104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 178us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185698.730760:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789185698.731056:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898415104:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185699.112300:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185699.750298:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898415232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185699.750380:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185699.750638:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898415232 00000100:00100000:0.0:1789185699.750648:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898415232 00000100:00100000:0.0:1789185699.750709:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789185699.750719:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898415232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185699.750747:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185699.750875:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898415232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185699.750886:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1789185699.751038:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185699.751071:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33fb100 x1876096898415232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185699.751089:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898415232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185699.751235:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898415360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185699.751269:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185699.751339:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898415360 00000100:00100000:0.0:1789185699.751344:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898415360 00000100:00100000:0.0:1789185699.751855:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789185699.751866:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898415360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185699.751881:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185699.751956:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898415360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185699.751962:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1789185699.752022:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185699.757175:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33f9c00 x1876096898415360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185699.757204:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898415360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185700.134228:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185701.164722:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185702.182177:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185702.258028:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185702.258079:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185702.258113:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185702.258141:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185702.258172:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185702.258201:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879449856 00000100:00100000:0.0:1789185702.258211:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879449856 00000100:00100000:0.0:1789185702.258269:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879450112 00000100:00100000:0.0:1789185702.258272:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879450112 00000100:00100000:0.0:1789185702.258286:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879449728 00000100:00100000:0.0:1789185702.258288:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879449728 00000100:00100000:0.0:1789185702.258300:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879449984 00000100:00100000:0.0:1789185702.258302:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879449984 00000100:00100000:0.0:1789185702.258319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 231 00000100:00100000:0.0:1789185702.258328:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879449856:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185702.258407:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879449856:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 79us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185702.258415:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 231 00000100:00100000:0.0:1789185702.258432:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 232 00000100:00100000:0.0:1789185702.258439:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879450112:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185702.258462:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879450112:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185702.258482:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 232 00000100:00100000:0.0:1789185702.258495:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 233 00000100:00100000:0.0:1789185702.258501:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879449728:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185702.258528:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2390:x1876096879449728:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185702.258533:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 233 00000100:00100000:0.0:1789185702.258543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 234 00000100:00100000:0.0:1789185702.258549:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879449984:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185702.258572:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879449984:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185702.258577:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 234 00000100:00080000:1.0:1789185702.258588:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185702.258592:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185702.258893:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879449600 00000100:00100000:2.0:1789185702.258903:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879449600 00000100:00100000:2.0:1789185702.258988:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 341 00000100:00100000:2.0:1789185702.258996:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879449600:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185702.259027:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879449600:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 32us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185702.259033:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 341 00000100:00100000:1.0:1789185702.310349:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898415488:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.310448:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185702.310500:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898416000:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.310525:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185702.310543:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898416512:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.310583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185702.310602:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898415616:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.310607:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898417024:0@lo:400:kworker.0 00000100:00100000:2.0:1789185702.310633:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185702.310637:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185702.310652:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898416128:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.310653:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789185702.310658:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898415872:0@lo:400:kworker.0 00000100:00100000:2.0:1789185702.310671:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185702.310688:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898416640:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.310691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185702.310947:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898415744:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.310966:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898416384:0@lo:400:kworker.0 00000100:00100000:0.0:1789185702.310976:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185702.310995:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898416256:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.310999:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185702.311016:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898416896:0@lo:400:kworker.0 00000100:00100000:0.0:1789185702.311023:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185702.311035:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185702.311067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898415488 00000100:00100000:1.0:1789185702.311074:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898415488 00000100:00100000:1.0:1789185702.311118:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789185702.311126:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898415488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.311173:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898415488:12345-0@lo:400:kworker.0 Request processed in 47us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185702.311179:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789185702.311212:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898416000 00000100:00100000:1.0:1789185702.311216:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898416000 00000100:00100000:1.0:1789185702.311238:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898415744 00000100:00100000:1.0:1789185702.311241:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898415744 00000100:00100000:1.0:1789185702.311252:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789185702.311257:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898416000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.311291:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898416000:12345-0@lo:400:kworker.0 Request processed in 34us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185702.311296:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789185702.311316:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789185702.311321:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898415744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.311348:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898415744:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185702.311353:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789185702.311369:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898416512 00000100:00100000:1.0:1789185702.311372:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898416512 00000100:00100000:1.0:1789185702.311396:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898417024 00000100:00100000:1.0:1789185702.311398:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898417024 00000100:00100000:1.0:1789185702.311410:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898416384 00000100:00100000:1.0:1789185702.311412:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898416384 00000100:00100000:1.0:1789185702.311422:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898416896 00000100:00100000:1.0:1789185702.311424:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898416896 00000100:00100000:1.0:1789185702.311435:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789185702.311441:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898416512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.311470:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898416512:12345-0@lo:400:kworker.0 Request processed in 30us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185702.311476:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789185702.311486:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789185702.311491:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898417024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.311516:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898417024:12345-0@lo:400:kworker.0 Request processed in 25us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185702.311521:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789185702.311531:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789185702.311536:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898416384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.311558:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898416384:12345-0@lo:400:kworker.0 Request processed in 22us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185702.311572:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789185702.311584:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789185702.311590:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898416896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.311632:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898416896:12345-0@lo:400:kworker.0 Request processed in 43us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185702.311637:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1789185702.312083:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185702.312087:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185702.312119:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300ed4380 x1876096898416384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185702.312133:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898416384:0@lo:400:kworker.0 00010000:00080000:1.0:1789185702.312144:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300ed6d80 x1876096898416896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185702.312151:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898416896:0@lo:400:kworker.0 00010000:00080000:1.0:1789185702.312161:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300ed7b80 x1876096898417024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185702.312169:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898417024:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.312179:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898415488:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.312187:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898416000:0@lo:400:kworker.0 00010000:00080000:1.0:1789185702.312197:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300ed6680 x1876096898416512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185702.312204:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898416512:0@lo:400:kworker.0 00000100:00100000:1.0:1789185702.312415:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898417408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185702.312465:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185702.326303:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898416768:0@lo:400:kworker.0 00000100:00100000:0.0:1789185702.326372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185702.326738:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898415616 00000100:00100000:2.0:1789185702.326748:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898415616 00000100:00100000:2.0:1789185702.326813:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898416128 00000100:00100000:2.0:1789185702.326832:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898416128 00000100:00100000:2.0:1789185702.326862:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898415872 00000100:00100000:2.0:1789185702.326865:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898415872 00000100:00100000:2.0:1789185702.326877:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898416256 00000100:00100000:2.0:1789185702.326880:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898416256 00000100:00100000:2.0:1789185702.326898:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789185702.326924:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898415616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185702.327081:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789185702.327091:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898416128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185702.327131:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898416128:12345-0@lo:400:kworker.0 Request processed in 43us (16459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185702.327140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789185702.327158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789185702.327164:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898415872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185702.327201:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898415872:12345-0@lo:400:kworker.0 Request processed in 37us (16509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185702.327345:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898417280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185702.327377:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185702.327413:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898415744:0@lo:400:kworker.0 00000100:00100000:3.0:1789185702.327517:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789185702.327529:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898416768 00000100:00100000:3.0:1789185702.327533:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898416768 00000100:00100000:3.0:1789185702.327554:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789185702.327560:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898416256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185702.327593:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898416256:12345-0@lo:400:kworker.0 Request processed in 33us (16568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185702.327599:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789185702.327703:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898415616:12345-0@lo:400:kworker.0 Request processed in 796us (17068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185702.327709:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789185702.327735:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789185702.327742:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898416768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185702.327774:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898416768:12345-0@lo:400:kworker.0 Request processed in 32us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185702.327780:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:2.0:1789185702.327810:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185702.327814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185702.327830:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185702.327862:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898417152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185702.328133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898416640 00000100:00100000:3.0:1789185702.328138:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898416640 00000100:00100000:3.0:1789185702.328170:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789185702.328176:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898416640:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789185702.328371:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300ed5f80 x1876096898416256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185702.328400:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898416256:0@lo:400:kworker.0 00010000:00080000:0.0:1789185702.328413:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300ed6300 x1876096898416768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185702.328423:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898416768:0@lo:400:kworker.0 00000100:00100000:0.0:1789185702.328541:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898417408 00000100:00100000:0.0:1789185702.328545:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898417408 00000100:00100000:0.0:1789185702.328569:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898417280 00000100:00100000:0.0:1789185702.328571:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898417280 00000100:00100000:0.0:1789185702.328582:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789185702.328588:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898417408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185702.328695:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789185702.328769:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185702.328825:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898415616:0@lo:400:kworker.0 00000100:00100000:2.0:1789185702.328837:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898416128:0@lo:400:kworker.0 00000100:00100000:2.0:1789185702.328848:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898416640:0@lo:400:kworker.0 00000100:00100000:2.0:1789185702.328876:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898417152 00000100:00100000:2.0:1789185702.328880:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898417152 00000100:00100000:2.0:1789185702.328920:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789185702.328928:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898417152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185702.328959:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185702.329002:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898417152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185702.329009:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1789185702.329040:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185702.329063:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898417152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185702.329372:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898416640:12345-0@lo:400:kworker.0 Request processed in 1194us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185702.329380:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789185702.329416:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898415872:0@lo:400:kworker.0 00000100:00100000:3.0:1789185702.329548:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789185702.329558:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898417280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789185702.329570:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185702.329606:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898417280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185702.329829:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789185702.329978:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898417408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1388us (17511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185702.329986:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:0.0:1789185702.330022:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2c87bb800 x1876096898417280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185702.330036:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898417280:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789185702.330124:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2c87b8000 x1876096898417408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185702.330137:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898417408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789185703.211607:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789185703.364844:0:13545:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:01:41 (1789185701) === 00000100:00100000:1.0:1789185703.559208:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185703.559605:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879450240 00000100:00100000:2.0:1789185703.559620:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879450240 00000100:00100000:2.0:1789185703.559689:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:2.0:1789185703.559712:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879450240:12345-192.168.204.48@tcp:41:mkdir.0 00000004:00000024:2.0:1789185703.559753:0:9473:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185703.559875:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879450240:12345-192.168.204.48@tcp:41:mkdir.0 Request processed in 176us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185703.559884:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:0.0:1789185703.561764:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185703.561885:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879450368 00000100:00100000:3.0:1789185703.561899:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879450368 00000100:00100000:3.0:1789185703.562022:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:3.0:1789185703.562035:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:10500:x1876096879450368:12345-192.168.204.48@tcp:700:mkdir.0 00000100:00100000:3.0:1789185703.562141:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:10500:x1876096879450368:12345-192.168.204.48@tcp:700:mkdir.0 Request processed in 110us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185703.562149:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:1.0:1789185703.564540:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185703.564999:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879450624 00000100:00100000:3.0:1789185703.565378:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879450624 00000100:00100000:3.0:1789185703.565499:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:3.0:1789185703.565513:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:10500:x1876096879450624:12345-192.168.204.48@tcp:36:mkdir.0 00010000:00010000:3.0:1789185703.565590:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185703.566026:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a72d9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cf1 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.566058:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2100) 00010000:00010000:3.0:1789185703.566072:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185703.567299:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.567323:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.567337:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.567391:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.567399:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.567406:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571441:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571464:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571504:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185703.571523:0:6514:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ec864ea reply state 00000000f918015b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571533:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571539:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2d2ecd200) 00010000:00010000:3.0:1789185703.571542:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185703.571546:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789185703.571552:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789185703.571559:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571565:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571571:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571577:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185703.571581:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571588:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571596:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2d2ecd800) 00010000:00010000:3.0:1789185703.571598:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185703.571623:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571629:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72ef8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185703.571649:0:6514:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ec864ea reply state 00000000f918015b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571657:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.571663:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f2d2ecd000) 00010000:00010000:3.0:1789185703.571665:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185703.571667:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789185703.571786:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:10500:x1876096879450624:12345-192.168.204.48@tcp:36:mkdir.0 Request processed in 6270us (7254us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789185703.571794:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:1.0:1789185703.588707:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185703.589122:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879450752 00000100:00100000:0.0:1789185703.589136:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879450752 00000100:00100000:0.0:1789185703.589318:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:0.0:1789185703.589334:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:10501:x1876096879450752:12345-192.168.204.48@tcp:101:chmod.0 00010000:00010000:0.0:1789185703.589368:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185703.589416:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d84 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.589653:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.589671:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.589686:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185703.589763:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789185703.589768:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185703.589817:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.590219:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d84 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.590242:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d84 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.590252:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33dc300) 00010000:00010000:0.0:1789185703.590255:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185703.590259:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031000, rc 0) 00000100:00100000:0.0:1789185703.590390:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:10501:x1876096879450752:12345-192.168.204.48@tcp:101:chmod.0 Request processed in 1059us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185703.590399:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:1.0:1789185703.598981:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185703.599037:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879451008 00000100:00100000:2.0:1789185703.599052:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879451008 00000100:00100000:2.0:1789185703.599121:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:2.0:1789185703.599132:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+8:10501:x1876096879451008:12345-192.168.204.48@tcp:36:chmod.0 00010000:00010000:2.0:1789185703.599208:0:9473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185703.599250:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d84 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.599274:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33dc300) 00010000:00010000:2.0:1789185703.599292:0:9473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185703.599329:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.599370:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.599384:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185703.600569:0:9473:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004af90116 reply state 000000004088f454 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.600595:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.600603:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2fae07800) 00010000:00010000:2.0:1789185703.600606:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789185703.600611:0:9473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789185703.600624:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789185703.600771:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+9:10501:x1876096879451008:12345-192.168.204.48@tcp:36:chmod.0 Request processed in 1636us (1802us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789185703.600781:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:1.0:1789185703.630674:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185703.631238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879451136 00000100:00100000:3.0:1789185703.631340:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879451136 00000100:00100000:2.0:1789185703.631639:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:2.0:1789185703.631654:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+9:10502:x1876096879451136:12345-192.168.204.48@tcp:101:chown.0 00010000:00010000:2.0:1789185703.631690:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185703.631732:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d8b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.631819:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a72f29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.631836:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a72f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.631869:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a72f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185703.631947:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789185703.631951:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185703.632000:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a72f29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.632033:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d8b expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.632057:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a72f29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d8b expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.632067:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2fae07800) 00010000:00010000:2.0:1789185703.632070:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185703.632075:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde000, rc 0) 00000100:00100000:2.0:1789185703.632219:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+10:10502:x1876096879451136:12345-192.168.204.48@tcp:101:chown.0 Request processed in 568us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185703.632228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:1.0:1789185703.635096:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185703.635196:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879451264 00000100:00100000:0.0:1789185703.635227:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879451264 00000100:00100000:0.0:1789185703.635306:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:0.0:1789185703.635319:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+10:10502:x1876096879451264:12345-192.168.204.48@tcp:101:chown.0 00010000:00010000:0.0:1789185703.635348:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185703.635385:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d92 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635473:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635491:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635505:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635531:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635550:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635557:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635659:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031600/0xda5c730d5a72f45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635668:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031600/0xda5c730d5a72f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635675:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031600/0xda5c730d5a72f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185703.635751:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789185703.635756:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185703.635786:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031600/0xda5c730d5a72f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635800:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635808:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635815:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635821:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185703.635826:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635834:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635848:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2fae07800) 00010000:00010000:0.0:1789185703.635851:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185703.635857:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635864:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a72f37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635881:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635898:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635904:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635964:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185703.635967:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635974:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635982:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f2d2ecd000) 00010000:00010000:0.0:1789185703.635985:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185703.635988:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.635994:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.636025:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d92 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.636041:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031600/0xda5c730d5a72f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d92 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.636049:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2d2ecd200) 00010000:00010000:0.0:1789185703.636051:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185703.636059:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031600, rc 0) 00000100:00100000:0.0:1789185703.636140:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+11:10502:x1876096879451264:12345-192.168.204.48@tcp:101:chown.0 Request processed in 823us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185703.636148:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:1.0:1789185703.642995:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185703.643086:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879451392 00000100:00100000:0.0:1789185703.643099:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879451392 00000100:00100000:0.0:1789185703.643162:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:0.0:1789185703.643172:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f993ea83-7802-4340-a17e-bffdbb8158b1+11:10502:x1876096879451392:12345-192.168.204.48@tcp:900:chown.0 00000100:00100000:0.0:1789185703.643274:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f993ea83-7802-4340-a17e-bffdbb8158b1+11:10502:x1876096879451392:12345-192.168.204.48@tcp:900:chown.0 Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185703.643282:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:2.0:1789185703.652640:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185703.652832:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879451648 00000100:00100000:0.0:1789185703.652847:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879451648 00000100:00100000:0.0:1789185703.652966:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:0.0:1789185703.652979:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+11:10502:x1876096879451648:12345-192.168.204.48@tcp:36:chown.0 00010000:00010000:0.0:1789185703.653061:0:9473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185703.653105:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031600/0xda5c730d5a72f45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d92 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.653129:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2d2ecd200) 00010000:00010000:0.0:1789185703.653135:0:9473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185703.653165:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.653180:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185703.653190:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185703.665592:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1789185703.666299:0:9473:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000067e15066 reply state 00000000ec00f03b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.666326:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.666337:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2d2ecd200) 00010000:00010000:2.0:1789185703.666359:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789185703.666365:0:9473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789185703.666381:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789185703.666645:0:9473:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789185703.666671:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+9:10502:x1876096879451648:12345-192.168.204.48@tcp:36:chown.0 Request processed in 13690us (14043us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789185703.666681:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 28 00010000:00010000:3.0:1789185703.668008:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.668035:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.668044:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.668052:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185703.668057:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.668083:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.668099:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2d2ecd200) 00010000:00010000:3.0:1789185703.668272:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789185703.668278:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.668286:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a72f4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670547:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670567:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670575:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670581:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185703.670586:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670594:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670613:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f2d2ecd000) 00010000:00010000:1.0:1789185703.670616:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185703.670621:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670640:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a72eff lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670663:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670670:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670676:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670681:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185703.670684:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.670689:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.671452:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2d2ecd200) 00010000:00010000:1.0:1789185703.671456:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185703.671462:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.671470:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a72f06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.671498:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.671505:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.671523:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.671529:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185703.671532:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.671539:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.671548:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2fae07800) 00010000:00010000:1.0:1789185703.671550:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789185703.671554:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.671560:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f1b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185703.693105:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185703.693226:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879451776 00000100:00100000:0.0:1789185703.693239:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879451776 00000100:00100000:0.0:1789185703.693432:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00100000:0.0:1789185703.693446:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:10503:x1876096879451776:12345-192.168.204.48@tcp:101:touch.500 00010000:00010000:0.0:1789185703.693480:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185703.693506:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51d99 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185703.697969:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4379us 00010000:00010000:2.0:1789185703.709343:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.709780:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.709798:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.709817:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.709824:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.709830:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710037:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710046:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710064:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185703.710105:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789185703.710110:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185703.710151:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710165:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710172:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710179:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710185:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185703.710191:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710199:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710211:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2fae07800) 00010000:00010000:2.0:1789185703.710220:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185703.710226:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710233:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710254:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710260:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710266:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710272:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185703.710275:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710282:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710289:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f2fae07900) 00010000:00010000:2.0:1789185703.710292:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185703.710294:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710299:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.710344:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a72f53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d99 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.711003:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d99 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.711061:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2fae07700) 00010000:00010000:2.0:1789185703.711064:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789185703.711067:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf600, rc 0) 00000100:00100000:2.0:1789185703.711189:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:10503:x1876096879451776:12345-192.168.204.48@tcp:101:touch.500 Request processed in 17745us (18096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185703.711197:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00100000:0.0:1789185703.715148:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185703.715267:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879452032 00000100:00100000:1.0:1789185703.715283:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879452032 00000100:00100000:1.0:1789185703.715395:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 30 00000100:00100000:1.0:1789185703.715409:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:10503:x1876096879452032:12345-192.168.204.48@tcp:101:touch.500 00010000:00010000:1.0:1789185703.715438:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185703.715466:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a72f6f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51da0 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.715628:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.715655:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.715691:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.721189:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.721215:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.721229:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185703.723174:0:8147:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789185703.723385:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72f84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723402:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723412:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72f84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723447:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723454:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723473:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723480:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185703.723484:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723492:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723506:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2fae07700) 00010000:00010000:2.0:1789185703.723510:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185703.723515:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723521:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a72f76 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185703.723540:0:8147:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dbcb270f reply state 000000006619ec13 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723552:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723557:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff98f2fae07000) 00010000:00010000:2.0:1789185703.723560:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185703.723563:0:8147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789185703.723601:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a72f6f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51da0 expref: 10 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723618:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72f84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51da0 expref: 9 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.723631:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f2fae07200) 00010000:00010000:2.0:1789185703.723634:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185703.723636:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddfa00, rc 0) 00000100:00100000:2.0:1789185703.725622:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+10:10503:x1876096879452032:12345-192.168.204.48@tcp:101:touch.500 Request processed in 10206us (10476us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789185703.725635:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 30 00000100:00100000:1.0:1789185703.733277:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185703.733364:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879452288 00000100:00100000:2.0:1789185703.733377:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879452288 00000100:00100000:2.0:1789185703.733478:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:2.0:1789185703.733490:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+10:10503:x1876096879452288:12345-192.168.204.48@tcp:36:touch.500 00010000:00010000:2.0:1789185703.733555:0:9473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185703.733584:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72f84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51da0 expref: 10 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.733602:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f2fae07200) 00010000:00010000:2.0:1789185703.733613:0:9473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185703.733684:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.733706:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.733718:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185703.733831:0:9473:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bbd18f46 reply state 00000000876c7316 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.733874:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.733880:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185703.733883:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185703.733886:0:9473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185703.734022:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+11:10503:x1876096879452288:12345-192.168.204.48@tcp:36:touch.500 Request processed in 534us (754us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789185703.734029:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:0.0:1789185703.736313:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185703.742679:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879452416 00000100:00100000:1.0:1789185703.742709:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879452416 00000100:00100000:1.0:1789185703.742797:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 32 00000100:00100000:1.0:1789185703.742810:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+11:10503:x1876096879452416:12345-192.168.204.48@tcp:101:touch.500 00010000:00010000:1.0:1789185703.742902:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185703.742946:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a72f99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51da7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.743006:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a72f99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51da7 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.743021:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a72f99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51da7 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.743038:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185703.743041:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185703.743045:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9e00, rc 0) 00000100:00100000:1.0:1789185703.743119:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+12:10503:x1876096879452416:12345-192.168.204.48@tcp:101:touch.500 Request processed in 311us (6813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185703.743126:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 32 00000100:00100000:0.0:1789185703.751255:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185703.751612:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879452544 00000100:00100000:1.0:1789185703.751624:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879452544 00000100:00100000:1.0:1789185703.751734:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:1.0:1789185703.751762:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f77e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876096879452544:12345-192.168.204.48@tcp:8:touch.500 00010000:00080000:1.0:1789185703.751796:0:9819:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:1.0:1789185703.751830:0:9819:0:(genops.c:1384:class_connect()) connect: client f993ea83-7802-4340-a17e-bffdbb8158b1, cookie 0xda5c730d5a72fa0 00002000:00100000:1.0:1789185703.751842:0:9819:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f993ea83-7802-4340-a17e-bffdbb8158b1/ffff98f1c30fd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789185703.751872:0:9819:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789185703.753553:0:9819:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789185703.753599:0:9819:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fe800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185703.753714:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f77e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2388:x1876096879452544:12345-192.168.204.48@tcp:8:touch.500 Request processed in 1949us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185703.753726:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:3.0:1789185703.760972:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185703.774336:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879452672 00000100:00100000:2.0:1789185703.774353:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879452672 00000100:00100000:0.0:1789185703.774593:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:0.0:1789185703.774620:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:0:x1876096879452672:12345-192.168.204.48@tcp:2:touch.500 00000100:00080000:2.0:1789185703.774634:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789185703.777951:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1789185703.777966:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000100:00100000:1.0:1789185703.778398:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:0:x1876096879452672:12345-192.168.204.48@tcp:2:touch.500 Request processed in 3783us (17433us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789185703.778411:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:0.0:1789185703.793406:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185703.793509:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879452928 00000100:00100000:3.0:1789185703.793520:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879452928 00000100:00100000:3.0:1789185703.793644:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:3.0:1789185703.793655:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+12:10503:x1876096879452928:12345-192.168.204.48@tcp:35:touch.500 00000100:00100000:3.0:1789185703.794049:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+13:10503:x1876096879452928:12345-192.168.204.48@tcp:35:touch.500 Request processed in 395us (655us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789185703.794058:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:0.0:1789185703.821539:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185703.821654:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879453056 00000100:00100000:2.0:1789185703.821667:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879453056 00000100:00100000:2.0:1789185703.821765:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:2.0:1789185703.821777:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+13:10504:x1876096879453056:12345-192.168.204.48@tcp:101:rm.0 00010000:00010000:2.0:1789185703.821804:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185703.821834:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72fa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51dae expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.822212:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72fae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.822230:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.822243:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185703.822310:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789185703.822314:0:8147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185703.822357:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.822389:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72fa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dae expref: 15 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.822408:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dae expref: 14 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.822417:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2fae07700) 00010000:00010000:2.0:1789185703.822420:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185703.822424:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf000, rc 0) 00000100:00100000:2.0:1789185703.822547:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+14:10504:x1876096879453056:12345-192.168.204.48@tcp:101:rm.0 Request processed in 772us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185703.822554:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:0.0:1789185703.832001:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185703.832550:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879453312 00000100:00100000:3.0:1789185703.832563:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879453312 00000100:00100000:3.0:1789185703.832631:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 34 00000100:00100000:3.0:1789185703.832648:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+14:10504:x1876096879453312:12345-192.168.204.48@tcp:101:rm.0 00010000:00010000:3.0:1789185703.832674:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185703.832715:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72fb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51db5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185703.832850:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789185703.832984:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72fb5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51db5 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.832999:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2fae07800) 00010000:00010000:3.0:1789185703.833002:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185703.833007:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db800/0xda5c730d5a72fb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51db5 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185703.833145:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db800, rc 0) 00000100:00100000:3.0:1789185703.833216:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+15:10504:x1876096879453312:12345-192.168.204.48@tcp:101:rm.0 Request processed in 575us (1225us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1789185703.833224:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 34 00000100:00100000:1.0:1789185703.836881:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185703.837470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879453440 00000100:00100000:3.0:1789185703.837482:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879453440 00000100:00100000:3.0:1789185703.837545:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:3.0:1789185703.837555:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+15:10504:x1876096879453440:12345-192.168.204.48@tcp:37:rm.0 00000100:00100000:3.0:1789185703.842988:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+15:10504:x1876096879453440:12345-192.168.204.48@tcp:37:rm.0 Request processed in 5423us (6105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185703.843001:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:1.0:1789185703.847160:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898417536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185703.847377:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185703.847410:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185703.847473:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898417536 00000100:00100000:0.0:1789185703.847482:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898417536 00000100:00100000:0.0:1789185703.847536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789185703.847545:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898417536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185703.847580:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185703.847636:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898417536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185703.847657:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789185703.847752:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898417536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185703.847991:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879453696 00000100:00100000:3.0:1789185703.847996:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879453696 00000100:00100000:3.0:1789185703.848042:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:3.0:1789185703.848050:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6596c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+15:10504:x1876096879453696:12345-192.168.204.48@tcp:35:rm.0 00000100:00100000:3.0:1789185703.848256:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6596c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+16:10504:x1876096879453696:12345-192.168.204.48@tcp:35:rm.0 Request processed in 206us (846us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789185703.848271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:0.0:1789185703.854370:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185703.854466:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879453952 00000100:00100000:1.0:1789185703.854476:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879453952 00000100:00100000:1.0:1789185703.854542:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 35 00000100:00100000:1.0:1789185703.854553:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+16:10504:x1876096879453952:12345-192.168.204.48@tcp:101:rm.0 00010000:00010000:1.0:1789185703.854578:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185703.854602:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72fc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51dbc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.854760:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a72fca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.854775:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a72fca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.854788:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a72fca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185703.854799:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789185703.855398:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72fc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dbc expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.855422:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a72fca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dbc expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.855431:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2fae07700) 00010000:00010000:1.0:1789185703.855435:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789185703.855438:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9400, rc 0) 00000100:00100000:1.0:1789185703.855511:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+18:10504:x1876096879453952:12345-192.168.204.48@tcp:101:rm.0 Request processed in 959us (1225us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789185703.855519:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 35 00000100:00100000:0.0:1789185703.860097:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185703.860170:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879454080 00000100:00100000:2.0:1789185703.860181:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879454080 00000100:00100000:2.0:1789185703.860245:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 36 00000100:00100000:2.0:1789185703.860255:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+18:10504:x1876096879454080:12345-192.168.204.48@tcp:41:rm.0 00000004:00000024:2.0:1789185703.861035:0:9473:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789185703.861127:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+18:10504:x1876096879454080:12345-192.168.204.48@tcp:41:rm.0 Request processed in 873us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185703.861136:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 36 00000100:00100000:0.0:1789185703.865422:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185703.865512:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879454208 00000100:00100000:2.0:1789185703.865522:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879454208 00000100:00100000:2.0:1789185703.865587:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 37 00000100:00100000:2.0:1789185703.865596:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:10504:x1876096879454208:12345-192.168.204.48@tcp:101:rm.0 00010000:00010000:2.0:1789185703.865617:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185703.865638:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a72fd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51dc3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.865891:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866029:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866046:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866060:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866069:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866075:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866279:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72fed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866289:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72fed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866310:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72fed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185703.866348:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789185703.866352:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185703.866371:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72fed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866383:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72fed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866391:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866398:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866406:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866412:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185703.866417:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866425:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866435:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2fae07700) 00010000:00010000:2.0:1789185703.866438:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185703.866443:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866459:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a72fdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866474:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866480:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866486:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866492:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185703.866495:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866502:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866509:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff98f2fae07000) 00010000:00010000:2.0:1789185703.866512:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185703.866515:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866521:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a72fe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866548:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a72fd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dc3 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866561:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72fed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dc3 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.866575:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185703.866577:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185703.866580:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddfa00, rc 0) 00000100:00100000:2.0:1789185703.866870:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+19:10504:x1876096879454208:12345-192.168.204.48@tcp:101:rm.0 Request processed in 1274us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185703.866878:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 37 00000100:00100000:0.0:1789185703.883643:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185703.883830:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879454464 00000100:00100000:1.0:1789185703.883843:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879454464 00000100:00100000:1.0:1789185703.883946:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 38 00000100:00100000:1.0:1789185703.883959:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+19:10504:x1876096879454464:12345-192.168.204.48@tcp:36:rm.0 00010000:00010000:1.0:1789185703.884029:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789185703.884076:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a72fed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dc3 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884101:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a72f99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51da7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884124:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185703.884137:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a72fae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dae expref: 17 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884146:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2fae07700) 00010000:00010000:1.0:1789185703.884149:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185703.884169:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884184:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884194:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884208:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884216:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884223:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884317:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884331:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.884339:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789185703.884885:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789185703.884897:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343046988165ns, next at 344046985856ns, rc = 0 00010000:00010000:1.0:1789185703.885102:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885224:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885235:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885243:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885249:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885255:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885384:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185703.885403:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885409:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885425:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885431:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185703.885435:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885443:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885454:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185703.885457:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789185703.885462:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885467:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a73002 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885484:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885491:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885496:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885501:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185703.885504:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885519:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885526:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2fae07700) 00010000:00010000:1.0:1789185703.885529:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185703.885531:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885536:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a72ff4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185703.885546:0:6512:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b6b60a68 reply state 00000000e8437804 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885557:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185703.885563:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff98f2fae07000) 00010000:00010000:1.0:1789185703.885565:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789185703.885567:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185703.885648:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+18:10504:x1876096879454464:12345-192.168.204.48@tcp:36:rm.0 Request processed in 1689us (2015us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789185703.885656:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 38 00010000:00010000:2.0:1789185703.888108:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185703.888237:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.888248:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185703.888253:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.888263:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.888280:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185703.888283:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789185703.888288:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.888295:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73009 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.888317:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185703.888319:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185703.888321:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185703.891584:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185703.891956:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879454720 00000100:00100000:3.0:1789185703.892181:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879454720 00000100:00100000:3.0:1789185703.892246:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:3.0:1789185703.892259:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+18:10504:x1876096879454720:12345-192.168.204.48@tcp:35:rm.0 00000100:00100000:3.0:1789185703.892559:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+19:10504:x1876096879454720:12345-192.168.204.48@tcp:35:rm.0 Request processed in 302us (982us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789185703.892568:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:0.0:1789185703.900155:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185703.900362:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879454976 00000100:00100000:2.0:1789185703.900388:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879454976 00000100:00100000:2.0:1789185703.900452:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 39 00000100:00100000:2.0:1789185703.900462:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+19:10504:x1876096879454976:12345-192.168.204.48@tcp:36:rm.0 00010000:00010000:2.0:1789185703.900589:0:9473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789185703.900621:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a72fca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dbc expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.900648:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a72f68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d99 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.901504:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2fae07700) 00010000:00010000:2.0:1789185703.901708:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a72f29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d8b expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.901721:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2fae07800) 00010000:00010000:2.0:1789185703.901727:0:9473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185703.901753:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.901766:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.901775:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.901792:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.901799:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.901823:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.902373:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.902384:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.902392:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185703.903392:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789185703.903412:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.903422:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.903430:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.903436:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185703.903441:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.903449:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.903461:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f2fae07a00) 00010000:00010000:2.0:1789185703.903464:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789185703.903480:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.903488:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a7301e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.903513:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.904119:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.904127:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.904132:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185703.904135:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.904143:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.904154:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2fae07200) 00010000:00010000:2.0:1789185703.904158:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185703.904161:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.904168:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73010 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185703.904185:0:9473:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f397b2f2 reply state 00000000a960ab7c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.904197:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185703.904214:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f2fae07300) 00010000:00010000:2.0:1789185703.904216:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185703.904219:0:9473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185703.904491:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+18:10504:x1876096879454976:12345-192.168.204.48@tcp:36:rm.0 Request processed in 4025us (4341us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789185703.904500:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 39 00010000:00010000:3.0:1789185704.230633:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185704.875258:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898417664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185704.875364:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185704.877655:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898417664 00000100:00100000:3.0:1789185704.877689:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898417664 00000100:00100000:3.0:1789185704.877796:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789185704.877818:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898417664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789185704.877861:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185704.878004:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898417664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (2642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185704.878012:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1789185704.878086:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33fa300 x1876096898417664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185704.878111:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898417664:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789185704.878769:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185704.881206:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898417792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185704.881305:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185704.881755:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898417792 00000100:00100000:2.0:1789185704.881768:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898417792 00000100:00100000:2.0:1789185704.881858:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789185704.881870:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898417792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185704.881904:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185704.882002:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898417792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185704.882009:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1789185704.882085:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300ed4000 x1876096898417792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185704.882110:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898417792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789185704.882970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789185705.254105:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185706.278116:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185707.305535:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185707.374275:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185707.374316:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185707.374342:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185707.374371:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185707.374388:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185707.374407:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185707.374447:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879455360 00000100:00100000:0.0:1789185707.374447:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879455616 00000100:00100000:1.0:1789185707.374456:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879455360 00000100:00100000:0.0:1789185707.374456:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879455616 00000100:00100000:2.0:1789185707.374526:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879455104 00000100:00100000:2.0:1789185707.374530:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879455104 00000100:00100000:2.0:1789185707.374583:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 343 00000100:00100000:2.0:1789185707.374593:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879455104:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185707.374668:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879455104:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185707.374675:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 343 00000100:00100000:3.0:1789185707.374852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879455232 00000100:00100000:3.0:1789185707.374856:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879455232 00000100:00100000:0.0:1789185707.374930:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879455744 00000100:00100000:0.0:1789185707.374933:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879455744 00000100:00100000:1.0:1789185707.378897:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 241 00000100:00080000:2.0:1789185707.378925:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185707.378934:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185707.378935:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879455616:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185707.378976:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879455488 00000100:00100000:2.0:1789185707.378986:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879455488 00000100:00100000:1.0:1789185707.379041:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879455616:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 132us (4697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185707.379049:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 93 00000100:00100000:2.0:1789185707.379060:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879455488:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185707.379070:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 241 00000100:00100000:2.0:1789185707.379098:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879455488:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 39us (4705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185707.379099:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 242 00000100:00100000:2.0:1789185707.379111:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 93 00000100:00100000:1.0:1789185707.379113:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879455360:12345-192.168.204.48@tcp:400:kworker.0 00000100:00080000:2.0:1789185707.379138:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185707.379153:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879455360:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 44us (4836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185707.379159:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 242 00000100:00100000:3.0:1789185707.380411:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 243 00000100:00100000:3.0:1789185707.380422:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:2392:x1876096879455232:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185707.380485:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:2392:x1876096879455232:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 65us (6112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185707.380503:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 243 00000100:00100000:0.0:1789185707.382321:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 244 00000100:00100000:0.0:1789185707.382334:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879455744:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185707.382414:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879455744:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 83us (8005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185707.382433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 244 00000100:00100000:3.0:1789185707.430264:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185707.430287:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898417920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185707.430360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185707.430640:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898417920 00000100:00100000:0.0:1789185707.430650:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898417920 00000100:00100000:3.0:1789185707.430980:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898418176:0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.431012:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185707.431032:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898418688:0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.431049:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185707.431146:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898418048:0@lo:400:kworker.0 00000100:00100000:1.0:1789185707.431179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185707.431236:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898418432:0@lo:400:kworker.0 00000100:00100000:2.0:1789185707.431266:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185707.432276:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898419200:0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.432316:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185707.432349:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898419712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185707.432369:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185707.432391:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789185707.432397:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898418304:0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.432414:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185707.432431:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898418816:0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.432448:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185707.432464:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898419328:0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.432480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185707.432509:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898419712 00000100:00100000:3.0:1789185707.432515:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898419712 00000100:00100000:3.0:1789185707.432565:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789185707.432574:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898419712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185707.432606:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185707.432785:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898418432 00000100:00100000:0.0:1789185707.432790:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898418432 00000100:00100000:0.0:1789185707.432811:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789185707.435332:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898419712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2754us (2956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185707.435343:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789185707.435387:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898418816 00000100:00100000:3.0:1789185707.435394:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898418816 00000100:00100000:3.0:1789185707.435438:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898419328 00000100:00100000:3.0:1789185707.435441:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898419328 00000100:00100000:3.0:1789185707.435465:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789185707.435472:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898418816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.435510:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898418816:12345-0@lo:400:kworker.0 Request processed in 38us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185707.435516:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789185707.435527:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789185707.435533:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898419328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.435560:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898419328:12345-0@lo:400:kworker.0 Request processed in 27us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185707.435565:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1789185707.435612:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758a680 x1876096898418816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185707.435775:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898417920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185707.435805:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789185707.435866:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898417920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3048us (5506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185707.435872:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789185707.435888:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789185707.435895:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898418432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185707.436180:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898418432:12345-0@lo:400:kworker.0 Request processed in 285us (4912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185707.436186:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789185707.436222:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898418176 00000100:00100000:0.0:1789185707.436227:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898418176 00000100:00100000:0.0:1789185707.436263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898418688 00000100:00100000:0.0:1789185707.436266:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898418688 00000100:00100000:0.0:1789185707.436279:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898419200 00000100:00100000:0.0:1789185707.436282:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898419200 00000100:00100000:0.0:1789185707.436293:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898418304 00000100:00100000:0.0:1789185707.436296:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898418304 00000100:00100000:0.0:1789185707.436307:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789185707.436313:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898418176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185707.436343:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898418176:12345-0@lo:400:kworker.0 Request processed in 30us (5330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185707.436363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789185707.436375:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789185707.436381:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898418688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185707.436410:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898418688:12345-0@lo:400:kworker.0 Request processed in 30us (5360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185707.436416:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789185707.436425:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789185707.436430:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898419200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185707.436452:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898419200:12345-0@lo:400:kworker.0 Request processed in 22us (4135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185707.436457:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789185707.436466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789185707.436471:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898418304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185707.436493:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898418304:12345-0@lo:400:kworker.0 Request processed in 22us (4077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185707.436498:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789185707.436533:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898418048 00000100:00100000:0.0:1789185707.436537:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898418048 00000100:00100000:0.0:1789185707.436564:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789185707.436570:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898418048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185707.436596:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898418048:12345-0@lo:400:kworker.0 Request processed in 27us (5417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185707.436601:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789185707.436796:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898418816:0@lo:400:kworker.0 00000100:00080000:0.0:1789185707.437132:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185707.437139:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185707.437152:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789185707.437224:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f278e680 x1876096898419328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185707.437237:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898419328:0@lo:400:kworker.0 00010000:00080000:3.0:1789185707.437255:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2c87bad80 x1876096898419712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185707.437275:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898419712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185707.437302:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898418176:0@lo:400:kworker.0 00010000:00080000:3.0:1789185707.437313:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c2c05180 x1876096898418688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185707.437320:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898418688:0@lo:400:kworker.0 00010000:00080000:3.0:1789185707.437331:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300252a00 x1876096898419200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185707.437339:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898419200:0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.437380:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898418304:0@lo:400:kworker.0 00000100:00100000:2.0:1789185707.437489:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898418432:0@lo:400:kworker.0 00000100:00100000:2.0:1789185707.437500:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898418944:0@lo:400:kworker.0 00000100:00100000:2.0:1789185707.437542:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185707.437583:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898419456:0@lo:400:kworker.0 00000100:00100000:2.0:1789185707.437606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185707.438095:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898418944 00000100:00100000:3.0:1789185707.438102:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898418944 00000100:00100000:3.0:1789185707.438154:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898419456 00000100:00100000:3.0:1789185707.438158:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898419456 00000100:00100000:3.0:1789185707.438174:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789185707.438182:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898418944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.438228:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898418944:12345-0@lo:400:kworker.0 Request processed in 47us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185707.438234:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789185707.438247:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789185707.438252:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898419456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.438273:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898419456:12345-0@lo:400:kworker.0 Request processed in 21us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185707.438278:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789185707.438381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898418048:0@lo:400:kworker.0 00000100:00100000:1.0:1789185707.438391:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898418560:0@lo:400:kworker.0 00000100:00100000:1.0:1789185707.438417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185707.438443:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898419072:0@lo:400:kworker.0 00000100:00100000:1.0:1789185707.438460:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185707.438479:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898418560 00000100:00100000:1.0:1789185707.438482:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898418560 00000100:00100000:1.0:1789185707.438505:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898419072 00000100:00100000:1.0:1789185707.438507:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898419072 00000100:00100000:1.0:1789185707.438522:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789185707.438527:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898418560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185707.438553:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898418560:12345-0@lo:400:kworker.0 Request processed in 25us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185707.438558:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789185707.438568:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789185707.438573:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898419072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185707.438606:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898419072:12345-0@lo:400:kworker.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185707.438612:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789185707.438652:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898419072:0@lo:400:kworker.0 00000100:00100000:1.0:1789185707.438659:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898419584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185707.438691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185707.438717:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898417920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185707.438742:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898418560:0@lo:400:kworker.0 00000100:00080000:2.0:1789185707.439192:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185707.439199:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185707.439225:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f2bdad80 x1876096898418944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185707.439236:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898418944:0@lo:400:kworker.0 00010000:00080000:2.0:1789185707.439246:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f278ce00 x1876096898419456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185707.439254:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898419456:0@lo:400:kworker.0 00000100:00100000:3.0:1789185707.439349:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898419584 00000100:00100000:3.0:1789185707.439355:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898419584 00000100:00100000:3.0:1789185707.439439:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789185707.439447:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898419584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789185707.439463:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185707.439515:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898419584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185707.439522:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1789185707.440278:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33fad80 x1876096898419584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185707.440297:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898419584:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789185708.327269:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185708.425900:0:13693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1789185708.971323:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185708.971355:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898419840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185708.971539:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185708.971647:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898419840 00000100:00100000:0.0:1789185708.971659:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898419840 00000100:00100000:0.0:1789185708.971718:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789185708.971729:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898419840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185708.971778:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185708.971835:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898419840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185708.971842:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789185708.972199:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898419840:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185709.355320:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789185709.814192:0:13742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb5ecae40 20000000:00000080:0.0:1789185709.814214:0:13742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f1c3750000 uarg=0000000000000000 20000000:01000000:0.0:1789185709.814261:0:13742:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789185709.814268:0:13742:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789185709.814274:0:13742:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789185709.815047:0:13743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789185709.815234:0:13742:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789185709.822704:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789185709.822771:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789185709.822789:0:13742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789185709.822808:0:13742:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789185709.822828:0:13742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.822849:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d76 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.822858:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72eb9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.822865:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ec7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.822889:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ed5 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.822898:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a72ee3 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.822942:0:13742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d7d expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.822952:0:13742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.822997:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d7d expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.823015:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d7d expref: 12 pid: 6505 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185709.823030:0:13742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898419968:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185709.823183:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72ee3 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.823193:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72ee3 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185709.823204:0:13742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420096:0@lo:104: 00000100:00100000:0.0:1789185709.823260:0:13742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185709.823298:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72ed5 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185709.823517:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789185709.823556:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898420096 00000100:00100000:1.0:1789185709.823568:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898420096 00000100:00100000:1.0:1789185709.823658:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789185709.823671:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f75b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:13742:x1876096898420096:12345-0@lo:104: 00010000:00010000:1.0:1789185709.823692:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.823814:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789185709.823822:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f75b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:13742:x1876096898420096:12345-0@lo:104: Request processed in 153us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185709.823832:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789185709.823836:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185709.823846:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.823855:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166da00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185709.823859:0:9518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.823869:0:9518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185709.823877:0:9518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185709.823883:0:9518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185709.823960:0:9518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.823967:0:9518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185709.823998:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.824017:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166da00/0xda5c730d5a72ee3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72eea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.824034:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185709.824036:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185709.824038:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185709.824219:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72ed5 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185709.824231:0:13742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f278ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420224:0@lo:104: 00000100:00100000:0.0:1789185709.824275:0:13742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185709.824364:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898420352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185709.824416:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185709.824473:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898420352 00000100:00100000:1.0:1789185709.824479:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898420352 00010000:00010000:0.0:1789185709.824493:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72ec7 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.824504:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72ec7 expref: 24 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.824510:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ee3 expref: 24 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185709.824524:0:13742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3563100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420480:0@lo:104: 00000100:00100000:1.0:1789185709.824550:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789185709.824563:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898420352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185709.824595:0:13742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185709.824708:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185709.824717:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ee3 expref: 24 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.824730:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72ee3 expref: 24 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.824754:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185709.824788:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898420224 00000100:00100000:3.0:1789185709.824797:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898420224 00000100:00100000:3.0:1789185709.824834:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898420480 00000100:00100000:3.0:1789185709.824838:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898420480 00000100:00100000:3.0:1789185709.824863:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789185709.824876:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:13742:x1876096898420224:12345-0@lo:104: 00000100:00100000:1.0:1789185709.824888:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898420352:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (469us total) trans 0 rc 0/0 00010000:00010000:3.0:1789185709.824889:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185709.824951:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:3.0:1789185709.825003:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185709.825014:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+4:13742:x1876096898420224:12345-0@lo:104: Request processed in 140us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185709.825021:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789185709.825045:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898420352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185709.825054:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185709.825068:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:13742:x1876096898420480:12345-0@lo:104: 00010000:00010000:3.0:1789185709.825076:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.825123:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789185709.825128:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+3:13742:x1876096898420480:12345-0@lo:104: Request processed in 64us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185709.825145:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1789185709.825166:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185709.825171:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.825178:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031a00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185709.825181:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.825189:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185709.825197:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185709.825203:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789185709.825389:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a72eb9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.825399:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a72eb9 expref: 23 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185709.825408:0:13742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3561880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420608:0@lo:104: 00000100:00100000:0.0:1789185709.825435:0:13742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185709.825459:0:13742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d76 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.825469:0:13742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d76 expref: 12 pid: 6507 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185709.825479:0:13742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420736:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185709.825530:0:13742:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15540 going to sleep for 11 seconds 00010000:00010000:0.0:1789185709.825553:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c13a2000/0xda5c730d5a72eea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72ee3 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185709.825568:0:13742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420096:0@lo:104: 00000100:00100000:0.0:1789185709.825590:0:13742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420224:0@lo:104: 00000100:00100000:0.0:1789185709.825599:0:13742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3563100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420480:0@lo:104: 00010000:00010000:1.0:1789185709.825739:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185709.825746:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.825759:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.825772:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185709.825797:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.825805:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a72ed5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72edc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.825821:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185709.825823:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185709.825825:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185709.825845:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:1.0:1789185709.825850:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.825860:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185709.825866:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185709.825873:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789185709.825891:0:9517:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.825897:0:9517:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185709.825947:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.825955:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166d400/0xda5c730d5a72ec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ece expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.825969:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185709.825971:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185709.825973:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185709.825982:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185709.825998:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898420992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185709.826038:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898420864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185709.826500:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898420608 00000100:00100000:1.0:1789185709.826509:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898420608 00000100:00100000:1.0:1789185709.826591:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789185709.826611:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:13742:x1876096898420608:12345-0@lo:104: 00010000:00010000:1.0:1789185709.826623:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.826687:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789185709.826694:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+3:13742:x1876096898420608:12345-0@lo:104: Request processed in 86us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185709.826701:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789185709.826809:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185709.826878:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898420864 00000100:00100000:3.0:1789185709.826883:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898420864 00010000:00010000:3.0:1789185709.826930:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ed5 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185709.826956:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789185709.826964:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3638:x1876096898420864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185709.827463:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185709.827475:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ed5 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.827490:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72ed5 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.827515:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166d600/0xda5c730d5a72edc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72ed5 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.827539:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185709.828033:0:13742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3561880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420608:0@lo:104: 00010000:00010000:1.0:1789185709.828457:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185709.828472:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.828484:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:1.0:1789185709.828490:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.828501:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185709.828508:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185709.828514:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789185709.828588:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.828596:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185709.828630:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.828663:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300dde800/0xda5c730d5a72eb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a72ec0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.828684:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185709.828685:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185709.828687:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185709.829013:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185709.829087:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898421120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185709.829151:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185709.829513:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3638:x1876096898420864:12345-0@lo:103:ldlm_bl.0 Request processed in 652us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185709.829528:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789185709.829560:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898420992 00000100:00100000:3.0:1789185709.829569:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898420992 00000100:00100000:1.0:1789185709.831492:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898421120 00000100:00100000:1.0:1789185709.831512:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898421120 00010000:00010000:1.0:1789185709.831596:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72eb9 expref: 23 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185709.831727:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789185709.831738:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3636:x1876096898421120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185709.831760:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185709.831775:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72eb9 expref: 23 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.831792:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72eb9 expref: 23 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.831816:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166c800/0xda5c730d5a72ec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72eb9 expref: 23 pid: 6506 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185709.831840:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185709.831963:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3636:x1876096898421120:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185709.831971:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789185709.835321:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898420864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185709.835542:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ec7 expref: 21 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185709.836467:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789185709.836492:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3636:x1876096898420992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185709.836534:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185709.836544:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a72ec7 expref: 21 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.836559:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a72ec7 expref: 21 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.836593:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166c000/0xda5c730d5a72ece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a72ec7 expref: 21 pid: 6507 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.836620:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185709.836718:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9010c27d-11d2-44c0-a2e4-e8975764c875+20:3636:x1876096898420992:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (7707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185709.836726:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789185709.837438:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185709.837484:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000001:00080000:0.0:1789185709.837517:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:2.0:1789185709.837547:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879456000 00000004:00080000:0.0:1789185709.837559:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789185709.837560:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879456000 00010000:00010000:2.0:1789185709.837636:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d76 expref: 13 pid: 6507 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185709.837676:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879455872 00000100:00100000:2.0:1789185709.837680:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879455872 00010000:00010000:2.0:1789185709.837695:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d7d expref: 14 pid: 6505 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185709.837718:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 50 00000100:00100000:2.0:1789185709.837727:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+14:2391:x1876096879456000:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185709.837742:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185709.837746:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d76 expref: 14 pid: 6507 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837756:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d76 expref: 14 pid: 6507 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837776:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185709.837823:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+14:2391:x1876096879456000:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 97us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185709.837830:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 50 00000100:00100000:2.0:1789185709.837861:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:2.0:1789185709.837885:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879455872:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185709.837893:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185709.837898:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d7d expref: 13 pid: 6505 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837927:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d7d expref: 13 pid: 6505 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837942:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837950:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837968:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837976:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837983:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837991:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.837998:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185709.838003:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.838013:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.838031:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.838040:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185709.838060:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879455872:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 177us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185709.838082:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:2.0:1789185709.838116:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185709.838130:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898421248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789185709.838186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185709.838198:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30da400/0xda5c730d5a72ef1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d7d expref: 12 pid: 6505 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185709.838219:0:13742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f278d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898419968:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185709.838241:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c1bf8800/0xda5c730d5a72eb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d76 expref: 11 pid: 6507 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185709.838265:0:13742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13742:1876096898420736:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185709.838315:0:13742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185709.838320:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898421248 00010000:00010000:0.0:1789185709.838328:0:13742:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185709.838330:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898421248 00010000:00010000:0.0:1789185709.838339:0:13742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185709.838358:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031600/0xda5c730d5a73025 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185709.838406:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185709.838417:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898421248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789185709.838453:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789185709.838497:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa4cea7, atime: 0x6aa4cea7, ctime: 0x6aa4cea7, blocks: 0x0 00010000:00010000:3.0:1789185709.838505:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.838523:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1789185709.838529:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185709.838536:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.838556:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.838587:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.838596:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.838624:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1789185709.839252:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185709.839322:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898421248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 903us (1131us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789185709.839332:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1789185709.839903:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f2f758d500/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789185709.839953:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898421248:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789185709.843461:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.843480:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.843487:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.843493:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddec00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185709.843498:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.843506:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.843552:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff98f2fae07000) 00010000:00010000:2.0:1789185709.843555:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789185709.843844:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898421120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185709.843886:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898420992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185709.844082:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844091:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a72f7d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844110:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844117:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844123:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844128:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185709.844132:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844138:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844147:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185709.844150:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185709.844153:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844158:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a72f92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844668:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844677:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844684:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844689:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9a00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185709.844693:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844699:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844709:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff98f2fae07000) 00010000:00010000:2.0:1789185709.844711:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185709.844715:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844720:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a72ffb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844735:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844741:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844746:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844758:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185709.844761:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844766:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844774:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f2fae07300) 00010000:00010000:2.0:1789185709.844775:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185709.844778:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185709.844783:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a73017 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.845671:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185709.845689:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.845705:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185709.845711:0:9518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.845724:0:9518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.845752:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.845760:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a9f1576/0xda5c730d5a7302c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185709.845808:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185709.845811:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185709.845813:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185709.990199:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185709.990227:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898421376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185709.990295:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185709.990750:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898421376 00000100:00100000:2.0:1789185709.990760:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898421376 00000100:00100000:2.0:1789185709.990810:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789185709.990819:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898421376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185709.990866:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185709.990945:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898421376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185709.990952:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789185709.991304:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185709.991316:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898421504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185709.991351:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185709.991428:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898421376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185709.991970:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898421504 00000100:00100000:2.0:1789185709.992113:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898421504 00000100:00100000:2.0:1789185709.992246:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789185709.992255:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898421504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185709.992280:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185709.992364:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898421504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185709.992370:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1789185709.992459:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185709.994304:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898421504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789185710.374983:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789185711.014808:0:13791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd348c80a0 20000000:00000080:1.0:1789185711.014830:0:13791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f1c3440800 uarg=0000000000000000 20000000:01000000:1.0:1789185711.014885:0:13791:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789185711.014894:0:13791:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789185711.014899:0:13791:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1789185711.019226:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789185711.022615:0:13791:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1789185711.022756:0:13791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1789185711.022788:0:13791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1789185711.022803:0:13791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1789185711.022815:0:13791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789185711.022837:0:13791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.022855:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.022867:0:13791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.022891:0:13791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.022898:0:13791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.023575:0:13791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.023587:0:13791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185711.023592:0:13791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.023600:0:13791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.023615:0:13791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.023623:0:13791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.023630:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a73033 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.398185:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185711.529459:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185711.534102:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879456128 00000100:00100000:1.0:1789185711.534120:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879456128 00000100:00100000:1.0:1789185711.534267:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 345 00000100:00100000:1.0:1789185711.534279:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+11:6163:x1876096879456128:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185711.534313:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185711.534337:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a7303a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51dca expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.534384:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a7303a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dca expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.534396:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a7303a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dca expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.534406:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9800, rc 0) 00000100:00100000:1.0:1789185711.534531:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879456128:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 Request processed in 254us (5083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185711.534538:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 345 00000100:00100000:3.0:1789185711.547781:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185711.548111:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879456256 00000100:00100000:0.0:1789185711.548123:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879456256 00000100:00100000:0.0:1789185711.548192:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 346 00000100:00100000:0.0:1789185711.548203:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879456256:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185711.548376:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879456256:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 Request processed in 173us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185711.548384:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 346 00000100:00100000:2.0:1789185711.551795:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185711.552019:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879456384 00000100:00100000:1.0:1789185711.552029:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879456384 00000100:00100000:1.0:1789185711.552103:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 347 00000100:00100000:1.0:1789185711.552113:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879456384:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185711.552274:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879456384:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 Request processed in 162us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185711.552282:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 347 00000100:00100000:3.0:1789185711.555265:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185711.556504:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879456512 00000100:00100000:1.0:1789185711.556521:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879456512 00000100:00100000:1.0:1789185711.556604:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 348 00000100:00100000:1.0:1789185711.556615:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:10789:x1876096879456512:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185711.556803:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:10789:x1876096879456512:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 190us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185711.556817:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 348 00000100:00100000:3.0:1789185711.568333:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185711.568502:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879456640 00000100:00100000:0.0:1789185711.568517:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879456640 00000100:00100000:0.0:1789185711.568608:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 349 00000100:00100000:0.0:1789185711.568620:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:10789:x1876096879456640:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789185711.568961:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:10789:x1876096879456640:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 343us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185711.568970:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 349 00000100:00100000:3.0:1789185711.585965:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185711.586141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879456768 00000100:00100000:2.0:1789185711.586153:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879456768 00000100:00100000:2.0:1789185711.586204:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 350 00000100:00100000:2.0:1789185711.586215:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:6163:x1876096879456768:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185711.586233:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185711.586250:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300dde800/0xda5c730d5a73041 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51dd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185711.586280:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300dde800/0xda5c730d5a73041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dd1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185711.586291:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300dde800/0xda5c730d5a73041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dd1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185711.586300:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde800, rc 0) 00000100:00100000:2.0:1789185711.586364:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879456768:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 Request processed in 150us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185711.586371:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 350 00000100:00100000:3.0:1789185711.589782:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185711.590040:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879456896 00000100:00100000:1.0:1789185711.590050:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879456896 00000100:00100000:1.0:1789185711.590108:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 351 00000100:00100000:1.0:1789185711.590119:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879456896:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185711.590288:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879456896:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 Request processed in 171us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185711.590296:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 351 00000100:00100000:3.0:1789185711.594186:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185711.594884:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879457024 00000100:00100000:0.0:1789185711.594896:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879457024 00000100:00100000:0.0:1789185711.595004:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 352 00000100:00100000:0.0:1789185711.595016:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879457024:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185711.595181:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:6163:x1876096879457024:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 Request processed in 166us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185711.595189:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 352 00000100:00100000:3.0:1789185711.599066:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185711.599468:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879457152 00000100:00100000:1.0:1789185711.599479:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879457152 00000100:00100000:1.0:1789185711.599537:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 353 00000100:00100000:1.0:1789185711.599558:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:10792:x1876096879457152:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185711.599956:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:10792:x1876096879457152:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 172us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185711.599965:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 353 00000100:00100000:3.0:1789185711.617102:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185711.618040:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879457280 00000100:00100000:1.0:1789185711.618051:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879457280 00000100:00100000:1.0:1789185711.618112:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 354 00000100:00100000:1.0:1789185711.618121:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:10792:x1876096879457280:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185711.618423:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:10792:x1876096879457280:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 299us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185711.618431:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 354 10000000:01000000:0.0:1789185711.846046:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789185711.846055:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2ff976000 from 7 10000000:01000000:0.0:1789185711.846060:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185711.846121:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185711.846136:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185711.846149:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185711.846180:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898421632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185711.846280:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185711.846454:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898421632 00000100:00100000:2.0:1789185711.846465:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898421632 00000100:00100000:2.0:1789185711.846522:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789185711.846531:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+20:6509:x1876096898421632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185711.846557:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185711.846584:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f300dde000/0xda5c730d5a7304f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73048 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185711.846610:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f300dde000/0xda5c730d5a7304f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73048 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185711.846619:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f300dde000/0xda5c730d5a7304f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73048 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185711.846629:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde000, rc 0) 00000100:00100000:2.0:1789185711.846676:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898421632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185711.846683:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789185711.846966:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d39c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185711.846990:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898421632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185711.847005:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185711.847015:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185711.847079:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898421760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185711.847110:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185711.847128:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d39c0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789185711.847495:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898421760 00000100:00100000:1.0:1789185711.847500:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898421760 00000100:00100000:1.0:1789185711.847555:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789185711.847564:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898421760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185711.848008:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898421760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 444us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185711.848015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789185711.848499:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898421760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789185711.848564:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898421888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789185711.848623:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185711.848859:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898421888 00000100:00100000:3.0:1789185711.848866:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898421888 00000100:00100000:3.0:1789185711.848934:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789185711.848944:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898421888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.849049:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898421888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.849056:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789185711.849843:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d39c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185711.849880:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898421888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.851654:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13804:1876096898422016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185711.851805:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185711.851954:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f74240c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185711.857016:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898422016 00000100:00100000:2.0:1789185711.857032:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898422016 00000100:00100000:3.0:1789185711.860823:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789185711.860851:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:13804:x1876096898422016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185711.861309:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:13804:x1876096898422016:12345-0@lo:502:llog_process_th.0 Request processed in 460us (9502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.861318:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789185711.861612:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13804:1876096898422016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789185711.861649:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185711.861724:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185711.861727:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789185711.861737:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f2ff976000 00000020:00000080:1.0:1789185711.861739:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185711.861849:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185711.861853:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185711.861855:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789185711.861858:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185711.861862:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185711.861863:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789185711.861866:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f2ff976000 00000020:00000080:1.0:1789185711.861869:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789185711.863195:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13804:1876096898422144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185711.863286:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185711.863781:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898422144 00000100:00100000:0.0:1789185711.863790:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898422144 00000100:00100000:0.0:1789185711.863843:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789185711.863852:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:13804:x1876096898422144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185711.864130:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:13804:x1876096898422144:12345-0@lo:502:llog_process_th.0 Request processed in 279us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185711.864138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789185711.864499:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185711.864525:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13804:1876096898422144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789185711.864564:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185711.864572:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185711.864574:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789185711.864580:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789185711.865104:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789185711.865132:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789185711.865145:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185711.865158:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185711.865170:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789185711.865173:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2d26ca000 from 7 10000000:01000000:0.0:1789185711.865175:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185711.865212:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185711.865221:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185711.865232:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185711.865253:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898422272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185711.865308:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185711.865470:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d39c0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.867479:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898422272 00000100:00100000:3.0:1789185711.867493:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898422272 00000100:00100000:3.0:1789185711.867619:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789185711.867630:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+21:6509:x1876096898422272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185711.867654:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185711.867672:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30db800/0xda5c730d5a7305d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73056 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.867700:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30db800/0xda5c730d5a7305d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73056 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.867711:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30db800/0xda5c730d5a7305d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73056 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.867720:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db800, rc 0) 00000100:00100000:3.0:1789185711.875249:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898422272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7611us (9930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.875264:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1789185711.876587:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898422272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185711.876634:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185711.876656:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185711.877345:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898422400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185711.877413:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185711.877466:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f28feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.877773:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898422400 00000100:00100000:3.0:1789185711.877781:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898422400 00000100:00100000:3.0:1789185711.877843:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789185711.877853:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898422400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.878029:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898422400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.878045:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789185711.879080:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898422400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185711.879138:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898422528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185711.879191:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185711.879225:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f28feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.879586:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898422528 00000100:00100000:3.0:1789185711.879594:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898422528 00000100:00100000:3.0:1789185711.879649:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789185711.879745:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898422528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.879870:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:6509:x1876096898422528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.879877:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789185711.879971:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898422528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.880233:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13807:1876096898422656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185711.880275:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185711.880311:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898422656 00000100:00100000:3.0:1789185711.880315:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898422656 00000100:00100000:2.0:1789185711.880464:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789185711.880476:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:13807:x1876096898422656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185711.880572:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:13807:x1876096898422656:12345-0@lo:502:llog_process_th.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185711.880580:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789185711.880635:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185711.880648:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13807:1876096898422656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185711.881251:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185711.881263:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185711.881266:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789185711.881273:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f2d26ca000 00000020:00000080:2.0:1789185711.881276:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789185711.881951:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185711.881958:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185711.881960:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789185711.881965:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185711.881968:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185711.881970:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789185711.881976:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f2d26ca000 00000020:00000080:2.0:1789185711.881978:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789185711.882048:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13807:1876096898422784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185711.882110:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185711.882155:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898422784 00000100:00100000:2.0:1789185711.882162:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898422784 00000100:00100000:2.0:1789185711.882208:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789185711.882216:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:13807:x1876096898422784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185711.882335:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+22:13807:x1876096898422784:12345-0@lo:502:llog_process_th.0 Request processed in 119us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.882821:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f28fecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.882851:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13807:1876096898422784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789185711.882886:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185711.882892:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185711.882894:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789185711.882900:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789185711.883009:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789185711.883064:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185711.883075:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.883086:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185711.883109:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185711.883112:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f30030e800 from 7 10000000:01000000:3.0:1789185711.883115:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185711.883143:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.883151:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.883160:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185711.883177:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898422912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.883213:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185711.883229:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15000 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.883243:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898422912 00000100:00100000:3.0:1789185711.883247:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898422912 00000100:00100000:3.0:1789185711.883269:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789185711.883276:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898422912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185711.883286:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185711.883300:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30da200/0xda5c730d5a7306b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73064 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.883326:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30da200/0xda5c730d5a7306b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73064 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185711.884062:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00010000:3.0:1789185711.885511:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30da200/0xda5c730d5a7306b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73064 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.885555:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da200, rc 0) 00000100:00100000:3.0:1789185711.886765:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898422912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3481us (3544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.886776:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789185711.887168:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898422912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185711.887268:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.887284:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185711.887432:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185711.887479:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185711.887521:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.888245:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898423040 00000100:00100000:3.0:1789185711.888253:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898423040 00000100:00100000:3.0:1789185711.888303:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789185711.888313:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898423040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.888643:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898423040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.888651:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789185711.889023:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185711.889068:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185711.889116:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185711.889153:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.889229:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898423168 00000100:00100000:3.0:1789185711.889234:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898423168 00000100:00100000:3.0:1789185711.889270:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789185711.889278:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898423168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.889829:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898423168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 550us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.889837:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789185711.890061:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185711.891549:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13809:1876096898423296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185711.891627:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185711.891678:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185711.891686:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898423296 00000100:00100000:0.0:1789185711.891695:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898423296 00000100:00100000:0.0:1789185711.891743:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789185711.891753:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:13809:x1876096898423296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185711.891893:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:13809:x1876096898423296:12345-0@lo:502:llog_process_th.0 Request processed in 142us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185711.891902:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789185711.892000:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13809:1876096898423296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185711.892027:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185711.892038:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185711.892041:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789185711.892285:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:0.0:1789185711.892747:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f30030e800 00000020:00000080:0.0:1789185711.892752:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185711.892807:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185711.892811:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185711.892813:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185711.892816:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185711.892818:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185711.892820:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789185711.892823:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f30030e800 00000020:00000080:0.0:1789185711.892825:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789185711.892864:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13809:1876096898423424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185711.892952:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185711.892982:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d6307d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.893152:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898423424 00000100:00100000:3.0:1789185711.893159:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898423424 00000100:00100000:3.0:1789185711.893202:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789185711.893210:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:13809:x1876096898423424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185711.893319:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+23:13809:x1876096898423424:12345-0@lo:502:llog_process_th.0 Request processed in 109us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.893327:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789185711.893403:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13809:1876096898423424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185711.893427:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185711.893436:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185711.893438:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789185711.893443:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789185711.893944:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789185711.893969:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185711.893980:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.893992:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185711.894004:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185711.894008:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2e7ae1000 from 7 10000000:01000000:3.0:1789185711.894011:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185711.894038:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.894046:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185711.894441:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185711.894463:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.894513:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185711.894622:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c1254840 going to sleep for 11 seconds 00000100:00100000:0.0:1789185711.895401:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898423552 00000100:00100000:0.0:1789185711.895410:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898423552 00000100:00100000:0.0:1789185711.895472:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789185711.895484:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:6509:x1876096898423552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185711.895498:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185711.895514:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73079 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73072 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185711.895614:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73072 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185711.895629:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73072 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185711.895638:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031000, rc 0) 00000100:00100000:0.0:1789185711.895698:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898423552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185711.895705:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789185711.895865:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185711.895885:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185711.895927:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185711.896016:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185711.896065:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185711.896097:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22d5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.897382:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898423680 00000100:00100000:3.0:1789185711.897392:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898423680 00000100:00100000:3.0:1789185711.897447:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789185711.897456:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898423680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.897628:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898423680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.897636:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789185711.897694:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.897738:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.897799:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185711.897826:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c1254840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185711.897838:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898423808 00000100:00100000:3.0:1789185711.897841:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898423808 00000100:00100000:3.0:1789185711.897863:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789185711.897870:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898423808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.897974:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:6509:x1876096898423808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185711.897981:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789185711.898018:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9010c27d-11d2-44c0-a2e4-e8975764c875:6509:1876096898423808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185711.898737:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13810:1876096898423936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185711.898779:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185711.898842:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789185711.900980:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898423936 00000100:00100000:0.0:1789185711.900996:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898423936 00000100:00100000:0.0:1789185711.901064:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789185711.901077:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:13810:x1876096898423936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185711.901286:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:13810:x1876096898423936:12345-0@lo:502:llog_process_th.0 Request processed in 212us (2505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185711.901295:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789185711.901650:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13810:1876096898423936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185711.901704:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185711.901713:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185711.901715:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185711.901722:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f2e7ae1000 00000020:00000080:0.0:1789185711.901724:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185711.901859:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185711.901863:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185711.901865:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185711.901869:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185711.901872:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185711.901874:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789185711.901879:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f2e7ae1000 00000020:00000080:0.0:1789185711.901881:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789185711.901953:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13810:1876096898424064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185711.901998:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185711.902032:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d63dd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185711.902060:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898424064 00000100:00100000:0.0:1789185711.902065:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898424064 00000100:00100000:0.0:1789185711.902089:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789185711.902096:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:13810:x1876096898424064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185711.902185:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:13810:x1876096898424064:12345-0@lo:502:llog_process_th.0 Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185711.902193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789185711.902422:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9010c27d-11d2-44c0-a2e4-e8975764c875:13810:1876096898424064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185711.902443:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185711.902448:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185711.902449:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789185711.902453:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789185711.903104:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789185711.903151:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185711.903163:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185711.903178:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185711.914945:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789185712.422447:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185712.488725:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185712.488777:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185712.489628:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185712.489658:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879457408 00000100:00100000:0.0:1789185712.489671:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879457408 00000100:00100000:0.0:1789185712.489738:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 375 00000100:00100000:0.0:1789185712.489747:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879457408:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185712.489821:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879457408:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 75us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185712.489828:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 375 00000100:00100000:2.0:1789185712.494070:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185712.494313:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879457664 00000100:00100000:3.0:1789185712.494327:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879457664 00000100:00100000:3.0:1789185712.494416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879457920 00000100:00100000:3.0:1789185712.494420:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879457920 00000100:00100000:3.0:1789185712.494446:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 251 00000100:00100000:3.0:1789185712.494459:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879457664:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185712.494562:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879457664:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 106us (5784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185712.494570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 251 00000100:00100000:3.0:1789185712.494604:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 252 00000100:00100000:3.0:1789185712.494626:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879457920:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185712.494651:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879457920:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 27us (5026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185712.494657:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 252 00000100:00080000:0.0:1789185712.495144:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185712.495149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185712.495723:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185712.495770:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185712.495809:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879457792 00000100:00100000:3.0:1789185712.495816:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879457792 00000100:00100000:3.0:1789185712.495872:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 98 00000100:00100000:3.0:1789185712.495879:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879457792:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185712.495958:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879457792:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185712.495965:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 98 00000100:00080000:1.0:1789185712.496046:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185712.496308:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879457536 00000100:00100000:0.0:1789185712.496313:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879457536 00000100:00080000:1.0:1789185712.496374:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185712.496402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879458048 00000100:00100000:3.0:1789185712.496406:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879458048 00000100:00100000:3.0:1789185712.496484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 253 00000100:00100000:3.0:1789185712.496502:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879457536:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185712.496556:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879457536:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 65us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185712.496563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 253 00000100:00100000:3.0:1789185712.496578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 254 00000100:00100000:3.0:1789185712.496584:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879458048:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185712.496611:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879458048:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 27us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185712.496617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 254 00000100:00080000:1.0:1789185712.496814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185712.552996:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898424192:0@lo:400:kworker.0 00000100:00100000:2.0:1789185712.553024:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898424448:0@lo:400:kworker.0 00000100:00100000:1.0:1789185712.553211:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898424320:0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.553451:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898424576:0@lo:400:kworker.0 00000100:00100000:2.0:1789185712.554342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185712.554408:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898424960:0@lo:400:kworker.0 00000100:00100000:2.0:1789185712.554445:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185712.554469:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898425472:0@lo:400:kworker.0 00000100:00100000:2.0:1789185712.556859:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185712.556997:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898424960 00000100:00100000:2.0:1789185712.557007:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898424960 00000100:00100000:2.0:1789185712.558780:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898425472 00000100:00100000:2.0:1789185712.558791:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898425472 00000100:00100000:2.0:1789185712.558841:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789185712.558852:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898424960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185712.558981:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898424960:12345-0@lo:400:kworker.0 Request processed in 131us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185712.558989:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789185712.559012:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789185712.559019:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898425472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185712.559056:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898425472:12345-0@lo:400:kworker.0 Request processed in 37us (4563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185712.559062:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1789185712.559094:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185712.559097:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185712.559133:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898424960:0@lo:400:kworker.0 00010000:00080000:2.0:1789185712.559148:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7488a80 x1876096898425472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185712.559158:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898425472:0@lo:400:kworker.0 00000100:00100000:1.0:1789185712.560611:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185712.560652:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898424832:0@lo:400:kworker.0 00000100:00100000:1.0:1789185712.560687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185712.561022:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898425984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185712.561058:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185712.561092:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185712.561097:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898425856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185712.561115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185712.561167:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898425984 00000100:00100000:2.0:1789185712.561173:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898425984 00000100:00100000:2.0:1789185712.561217:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789185712.561225:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898425984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789185712.561269:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185712.561316:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898425984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185712.561323:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1789185712.561361:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e0700 x1876096898425984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185712.561381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898425984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185712.561414:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898424320 00000100:00100000:2.0:1789185712.561418:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898424320 00000100:00100000:2.0:1789185712.561440:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898425856 00000100:00100000:2.0:1789185712.561442:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898425856 00000100:00100000:2.0:1789185712.561454:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789185712.561459:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898424320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185712.563480:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898424320:12345-0@lo:400:kworker.0 Request processed in 33us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185712.563580:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789185712.563624:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789185712.563640:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898425856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185712.563679:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185712.563776:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898425856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185712.563782:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789185712.563845:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898425856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185712.567543:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185712.567607:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898425088:0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.567643:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185712.567678:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898425600:0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.567699:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185712.567737:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185712.567743:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898425728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185712.567767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185712.567798:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898425728 00000100:00100000:0.0:1789185712.567807:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898425728 00000100:00100000:0.0:1789185712.567866:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789185712.567874:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898425728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185712.567900:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185712.567960:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898425728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185712.567984:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1789185712.568005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185712.568016:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898425088 00000100:00100000:0.0:1789185712.568020:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898425088 00000100:00100000:0.0:1789185712.568046:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898425600 00000100:00100000:0.0:1789185712.568049:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898425600 00000100:00100000:0.0:1789185712.568066:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789185712.568071:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898425088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.568106:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898425088:12345-0@lo:400:kworker.0 Request processed in 35us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185712.568111:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789185712.568122:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789185712.568127:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898425600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.568152:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898425600:12345-0@lo:400:kworker.0 Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185712.568158:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1789185712.568175:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789185712.568205:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2c87b8000 x1876096898425728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185712.568224:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898425728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185712.568236:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898425088:0@lo:400:kworker.0 00010000:00080000:0.0:1789185712.568245:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e1f80 x1876096898425600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185712.568252:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898425600:0@lo:400:kworker.0 00000100:00100000:2.0:1789185712.569510:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898424576 00000100:00100000:2.0:1789185712.569521:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898424576 00000100:00100000:2.0:1789185712.569602:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789185712.569610:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898424576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185712.569690:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898424576:12345-0@lo:400:kworker.0 Request processed in 79us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185712.569696:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789185712.570486:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898424576:0@lo:400:kworker.0 00000100:00100000:3.0:1789185712.575033:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898424448 00000100:00100000:3.0:1789185712.575051:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898424448 00000100:00100000:3.0:1789185712.575128:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898424832 00000100:00100000:3.0:1789185712.575131:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898424832 00000100:00080000:3.0:1789185712.575166:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185712.575199:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789185712.575209:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898424448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.576160:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185712.576300:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898424192 00000100:00100000:0.0:1789185712.576307:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898424192 00000100:00100000:0.0:1789185712.576343:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789185712.576351:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898424832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.576424:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898424832:12345-0@lo:400:kworker.0 Request processed in 74us (15735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185712.576979:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789185712.577020:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789185712.577028:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898424192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.577071:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898424192:12345-0@lo:400:kworker.0 Request processed in 45us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185712.577077:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789185712.577129:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898424192:0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.577141:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898424704:0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.577173:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185712.577197:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898424704 00000100:00100000:0.0:1789185712.577202:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898424704 00000100:00100000:0.0:1789185712.577234:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789185712.577239:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898424704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.577269:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898424704:12345-0@lo:400:kworker.0 Request processed in 29us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185712.577274:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789185712.577300:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898424704:0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.577308:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898425216:0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.577345:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185712.577363:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898425216 00000100:00100000:0.0:1789185712.577366:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898425216 00000100:00100000:0.0:1789185712.577385:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789185712.577390:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898425216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.577417:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898425216:12345-0@lo:400:kworker.0 Request processed in 27us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185712.577423:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789185712.577574:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898425216:0@lo:400:kworker.0 00000100:00080000:2.0:1789185712.579136:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185712.580295:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98380 x1876096898424832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185712.580314:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898424832:0@lo:400:kworker.0 00000100:00100000:1.0:1789185712.580326:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898425344:0@lo:400:kworker.0 00000100:00100000:1.0:1789185712.580387:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185712.580646:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898424320:0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.580712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898425344 00000100:00100000:0.0:1789185712.580719:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898425344 00000100:00100000:0.0:1789185712.580792:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789185712.580802:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898425344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185712.580856:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898425344:12345-0@lo:400:kworker.0 Request processed in 56us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185712.580862:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00080000:1.0:1789185712.581044:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f748aa00 x1876096898425344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185712.581055:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898425344:0@lo:400:kworker.0 00000100:00100000:3.0:1789185712.581276:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898424448:12345-0@lo:400:kworker.0 Request processed in 6066us (26934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185712.581285:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789185712.581466:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898424448:0@lo:400:kworker.0 00000100:00080000:2.0:1789185712.582623:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1789185712.935176:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789185712.936041:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789185713.447719:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185714.086370:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898426112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185714.086456:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185714.086600:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898426112 00000100:00100000:3.0:1789185714.086609:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898426112 00000100:00100000:3.0:1789185714.086667:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789185714.086677:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898426112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185714.086712:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789185714.086768:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898426112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185714.086775:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789185714.086850:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898426112:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185714.470551:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185715.110366:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185715.110391:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898426240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185715.110472:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185715.110697:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898426368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185715.110725:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185715.110823:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898426240 00000100:00100000:1.0:1789185715.110833:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898426240 00000100:00100000:1.0:1789185715.110901:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898426368 00000100:00100000:1.0:1789185715.110905:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898426368 00000100:00100000:1.0:1789185715.110943:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789185715.110953:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898426240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185715.111003:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185715.111051:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898426240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185715.111058:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789185715.111078:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789185715.111084:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898426368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185715.111094:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185715.111120:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898426368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185715.111125:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789185715.111295:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898426240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185715.111328:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898426368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789185715.111461:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789185715.495062:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789185715.629125:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1789185716.520025:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185717.550757:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185717.608589:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185717.608632:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185717.608723:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185717.609102:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879458304 00000100:00100000:2.0:1789185717.609113:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879458304 00000100:00100000:1.0:1789185717.609142:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185717.609166:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185717.609230:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185717.609342:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879458560 00000100:00100000:0.0:1789185717.609348:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879458560 00000100:00100000:0.0:1789185717.609385:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 103 00000100:00100000:0.0:1789185717.609395:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879458560:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185717.609407:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879458816 00000100:00100000:2.0:1789185717.609412:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879458816 00000100:00100000:0.0:1789185717.609483:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879458560:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 88us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.609506:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 103 00000100:00100000:2.0:1789185717.609813:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879458432 00000100:00100000:2.0:1789185717.609819:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879458432 00000100:00100000:3.0:1789185717.609883:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 261 00000100:00100000:3.0:1789185717.609894:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879458304:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185717.609955:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879458304:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 64us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185717.609961:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 261 00000100:00100000:3.0:1789185717.609977:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 262 00000100:00100000:3.0:1789185717.609984:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879458816:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185717.610008:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879458816:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185717.610013:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 262 00000100:00100000:3.0:1789185717.610026:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 263 00000100:00100000:3.0:1789185717.610032:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879458432:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185717.610056:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879458432:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185717.610061:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 263 00000100:00100000:0.0:1789185717.612388:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879458176 00000100:00100000:0.0:1789185717.612405:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879458176 00000100:00100000:0.0:1789185717.612495:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 376 00000100:00100000:0.0:1789185717.612507:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879458176:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185717.612712:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879458176:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 207us (3569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.612720:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 376 00000100:00080000:0.0:1789185717.612839:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185717.612845:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185717.612848:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185717.613422:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879458688 00000100:00100000:0.0:1789185717.613440:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879458688 00000100:00100000:0.0:1789185717.613546:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 264 00000100:00100000:0.0:1789185717.613555:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879458688:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185717.613599:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879458688:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 45us (4368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.613605:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 264 00000100:00080000:1.0:1789185717.617340:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185717.670481:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898426496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185717.670582:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185717.671019:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898427008:0@lo:400:kworker.0 00000100:00100000:2.0:1789185717.671057:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185717.671080:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898427520:0@lo:400:kworker.0 00000100:00100000:2.0:1789185717.671103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185717.671122:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898428032:0@lo:400:kworker.0 00000100:00100000:2.0:1789185717.671140:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185717.671165:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789185717.671171:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898426880:0@lo:400:kworker.0 00000100:00100000:2.0:1789185717.671194:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185717.671211:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898427392:0@lo:400:kworker.0 00000100:00100000:2.0:1789185717.671233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185717.671250:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898427904:0@lo:400:kworker.0 00000100:00100000:2.0:1789185717.671285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185717.671550:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898426880 00000100:00100000:0.0:1789185717.671558:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898426880 00000100:00100000:0.0:1789185717.671606:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789185717.671615:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898426880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185717.676107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898427008 00000100:00100000:3.0:1789185717.676119:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898427008 00000100:00100000:3.0:1789185717.676179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898427392 00000100:00100000:3.0:1789185717.676182:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898427392 00000100:00100000:3.0:1789185717.676213:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898427904 00000100:00100000:3.0:1789185717.676216:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898427904 00000100:00100000:3.0:1789185717.676255:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789185717.676265:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898427008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.676425:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789185717.676455:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898427392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.676511:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898427392:12345-0@lo:400:kworker.0 Request processed in 58us (5277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.676519:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789185717.676541:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789185717.676548:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898427904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185717.676648:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898426496 00000100:00100000:1.0:1789185717.676653:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898426496 00000100:00080000:1.0:1789185717.676663:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185717.676681:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185717.676704:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898427904:12345-0@lo:400:kworker.0 Request processed in 156us (5418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185717.676709:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789185717.676711:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789185717.676716:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898426496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185717.676738:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185717.676757:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898426880:12345-0@lo:400:kworker.0 Request processed in 5142us (5561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.676764:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789185717.676812:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898427520 00000100:00100000:0.0:1789185717.676817:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898427520 00000100:00100000:0.0:1789185717.676844:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898428032 00000100:00100000:0.0:1789185717.676847:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898428032 00000100:00100000:0.0:1789185717.676867:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789185717.676872:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898427520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.682348:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898427520:12345-0@lo:400:kworker.0 Request processed in 5463us (11232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.682365:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789185717.682404:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789185717.682418:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898428032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.682486:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898428032:12345-0@lo:400:kworker.0 Request processed in 74us (11344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.682492:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1789185717.682584:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185717.682591:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185717.682627:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898426752:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.682669:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185717.682700:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898426752 00000100:00100000:0.0:1789185717.682708:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898426752 00000100:00100000:0.0:1789185717.682742:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789185717.682749:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.682781:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898426752:12345-0@lo:400:kworker.0 Request processed in 32us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.682787:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789185717.682834:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898426752:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.682843:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898427264:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.682866:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185717.682883:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898427264 00000100:00100000:0.0:1789185717.682887:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898427264 00000100:00100000:0.0:1789185717.682933:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789185717.682939:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898427264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.682969:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898427264:12345-0@lo:400:kworker.0 Request processed in 30us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.682974:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:0.0:1789185717.682987:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185717.683007:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898427264:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.683014:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898427776:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.683036:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185717.683055:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898427776 00000100:00100000:0.0:1789185717.683066:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898427776 00000100:00100000:0.0:1789185717.683093:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789185717.683099:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898427776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.683131:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898427776:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.683137:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:0.0:1789185717.683152:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185717.683171:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898427776:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.683178:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898428288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185717.683208:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185717.683231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898428288 00000100:00100000:0.0:1789185717.683234:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898428288 00000100:00100000:0.0:1789185717.683259:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789185717.683265:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898428288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185717.683292:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789185717.683325:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898428288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.683331:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789185717.683363:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898428288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185717.683395:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789185717.683403:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898426624:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.683442:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185717.683469:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898427136:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.683492:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185717.683508:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898427648:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.683543:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185717.683564:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898427648 00000100:00100000:0.0:1789185717.683567:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898427648 00000100:00100000:0.0:1789185717.683595:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789185717.683601:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898427648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.683629:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898427648:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.683635:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1789185717.683651:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185717.683666:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789185717.683671:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f2f758d500, transno 4294967301 00000100:00100000:0.0:1789185717.683681:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898427648:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.683814:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898428160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185717.683842:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185717.683865:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898428160 00000100:00100000:0.0:1789185717.683869:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898428160 00000100:00100000:0.0:1789185717.683891:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789185717.683898:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898428160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789185717.683926:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185717.683951:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898428160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.683957:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:0.0:1789185717.683981:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300d98000 x1876096898428160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185717.683996:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898428160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185717.684017:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898427136 00000100:00100000:0.0:1789185717.684026:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898427136 00000100:00100000:0.0:1789185717.684051:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789185717.684057:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898427136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.684089:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898427136:12345-0@lo:400:kworker.0 Request processed in 33us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.684095:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789185717.684115:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898427136:0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.684231:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898426624 00000100:00100000:0.0:1789185717.684235:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898426624 00000100:00100000:0.0:1789185717.684259:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789185717.684265:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898426624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185717.684301:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898426624:12345-0@lo:400:kworker.0 Request processed in 35us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185717.684307:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789185717.684340:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898426624:0@lo:400:kworker.0 00000100:00100000:1.0:1789185717.689238:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898426496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12508us (18641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185717.689274:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1789185717.694223:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff981f80 x1876096898427904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185717.694245:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898427904:0@lo:400:kworker.0 00000100:00100000:2.0:1789185717.694264:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898427520:0@lo:400:kworker.0 00010000:00080000:2.0:1789185717.694276:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff980380 x1876096898428032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185717.694284:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898428032:0@lo:400:kworker.0 00010000:00080000:2.0:1789185717.694314:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2c1324a80 x1876096898426496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185717.694332:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898426496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185717.694363:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898426880:0@lo:400:kworker.0 00010000:00080000:2.0:1789185717.694374:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e0700 x1876096898427392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185717.694383:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898427392:0@lo:400:kworker.0 00000100:00100000:3.0:1789185717.697078:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898427008:12345-0@lo:400:kworker.0 Request processed in 20803us (26008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185717.697094:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789185717.697265:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898427008:0@lo:400:kworker.0 00010000:00010000:3.0:1789185718.567340:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185719.206728:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898428416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185719.206808:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185719.207006:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898428416 00000100:00100000:1.0:1789185719.207015:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898428416 00000100:00100000:1.0:1789185719.207079:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789185719.207090:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898428416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185719.207139:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185719.207193:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898428416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185719.207200:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789185719.207433:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898428416:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185719.590463:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185720.230306:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898428544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185720.230400:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185720.230533:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898428544 00000100:00100000:2.0:1789185720.230543:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898428544 00000100:00100000:2.0:1789185720.230606:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789185720.230620:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898428544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185720.230652:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185720.230710:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898428544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185720.230735:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1789185720.230974:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185720.231013:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898428544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185720.231034:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185720.231044:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898428672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185720.231077:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185720.231118:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898428672 00000100:00100000:0.0:1789185720.231130:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898428672 00000100:00100000:0.0:1789185720.231164:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789185720.231170:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898428672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185720.231181:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185720.231216:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898428672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185720.231223:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1789185720.231238:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185720.231260:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898428672:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789185720.615447:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185721.647470:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185722.150672:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789185722.151416:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789185722.662527:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185722.727327:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185722.727392:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185722.727522:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879459072 00000100:00100000:0.0:1789185722.727534:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879459072 00000100:00100000:0.0:1789185722.727613:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 271 00000100:00100000:0.0:1789185722.727625:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879459072:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185722.727710:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879459072:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 88us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.727717:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 271 00000100:00100000:3.0:1789185722.728606:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185722.728654:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185722.728676:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185722.728721:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185722.728756:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879459584 00000100:00100000:3.0:1789185722.728762:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879459584 00000100:00100000:3.0:1789185722.728799:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879459200 00000100:00100000:3.0:1789185722.728802:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879459200 00000100:00100000:3.0:1789185722.728816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879459456 00000100:00100000:3.0:1789185722.728818:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879459456 00000100:00100000:3.0:1789185722.728832:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 272 00000100:00100000:3.0:1789185722.728839:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879459584:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185722.729038:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879459584:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 198us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185722.729047:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 272 00000100:00100000:0.0:1789185722.729175:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 273 00000100:00100000:0.0:1789185722.729185:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879459200:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185722.729218:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879459200:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 35us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.729236:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 273 00000100:00100000:0.0:1789185722.729266:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 274 00000100:00100000:0.0:1789185722.729272:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879459456:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185722.729296:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879459456:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.729316:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 274 00000100:00100000:0.0:1789185722.729354:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879458944 00000100:00100000:0.0:1789185722.729358:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879458944 00000100:00100000:0.0:1789185722.729386:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 378 00000100:00100000:0.0:1789185722.729392:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879458944:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185722.729418:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879458944:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 26us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.729424:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 378 00000100:00080000:2.0:1789185722.731743:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185722.731756:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185722.735495:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879459328 00000100:00100000:1.0:1789185722.735512:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879459328 00000100:00100000:1.0:1789185722.735611:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 107 00000100:00100000:1.0:1789185722.735623:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879459328:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185722.735731:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879459328:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 111us (8338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185722.735739:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 107 00000100:00080000:2.0:1789185722.736271:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185722.790378:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898428928:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.790474:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185722.790538:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898429440:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.790559:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185722.790581:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898429952:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.790597:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185722.790620:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789185722.790625:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898429056:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.790645:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185722.790658:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898429568:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.790673:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185722.790686:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898430080:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.790702:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185722.790730:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898428928 00000100:00100000:2.0:1789185722.790737:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898428928 00000100:00100000:2.0:1789185722.790773:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898429440 00000100:00100000:2.0:1789185722.790775:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898429440 00000100:00100000:2.0:1789185722.790799:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898429952 00000100:00100000:2.0:1789185722.790801:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898429952 00000100:00100000:2.0:1789185722.790809:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898429568 00000100:00100000:2.0:1789185722.790811:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898429568 00000100:00100000:2.0:1789185722.790821:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898430080 00000100:00100000:2.0:1789185722.790829:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898430080 00000100:00100000:2.0:1789185722.790846:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789185722.790854:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898428928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.790948:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898428928:12345-0@lo:400:kworker.0 Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185722.790956:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789185722.790975:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789185722.790981:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898429440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.791007:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898429440:12345-0@lo:400:kworker.0 Request processed in 27us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185722.791014:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789185722.791026:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789185722.791031:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898429952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.791056:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898429952:12345-0@lo:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185722.791061:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789185722.791075:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789185722.791081:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898429568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.791109:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898429568:12345-0@lo:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185722.791115:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789185722.791128:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789185722.791135:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898430080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185722.791147:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898429184:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.791177:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898430080:12345-0@lo:400:kworker.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185722.791203:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1789185722.791232:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185722.791237:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789185722.791278:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff983800 x1876096898429568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185722.791292:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898429568:0@lo:400:kworker.0 00010000:00080000:2.0:1789185722.791303:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff980700 x1876096898430080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185722.791311:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898430080:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.791321:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898428928:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.791328:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898429440:0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.791347:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898429952:0@lo:400:kworker.0 00000100:00100000:3.0:1789185722.791491:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185722.791805:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898428800:0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.791858:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185722.791902:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898429312:0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.791949:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185722.791969:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898429824:0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.791991:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185722.792009:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898430336:0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.792026:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185722.792172:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898429056 00000100:00100000:0.0:1789185722.792180:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898429056 00000100:00100000:0.0:1789185722.792213:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898429312 00000100:00100000:0.0:1789185722.792216:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898429312 00000100:00100000:0.0:1789185722.792306:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789185722.792314:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898429056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.792378:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898429056:12345-0@lo:400:kworker.0 Request processed in 65us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.792385:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789185722.792410:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789185722.792416:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898429312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.792448:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898429312:12345-0@lo:400:kworker.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.792453:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789185722.792504:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898428800 00000100:00100000:0.0:1789185722.792507:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898428800 00000100:00100000:0.0:1789185722.792531:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789185722.792538:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898428800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.792568:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898428800:12345-0@lo:400:kworker.0 Request processed in 30us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.792574:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789185722.792599:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898429824 00000100:00100000:0.0:1789185722.792602:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898429824 00000100:00100000:0.0:1789185722.792629:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898430336 00000100:00100000:0.0:1789185722.792632:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898430336 00000100:00100000:0.0:1789185722.792651:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789185722.792658:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898429824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.792687:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898429824:12345-0@lo:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.792694:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789185722.792705:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789185722.792711:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898430336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.792737:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898430336:12345-0@lo:400:kworker.0 Request processed in 27us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.792743:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789185722.792765:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185722.792781:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898430464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185722.792810:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185722.792839:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898430464 00000100:00100000:0.0:1789185722.792843:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898430464 00000100:00100000:0.0:1789185722.792870:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789185722.792876:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898430464:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185722.793283:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898430592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185722.793315:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185722.793367:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898430592 00000100:00100000:1.0:1789185722.793371:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898430592 00000100:00100000:1.0:1789185722.793391:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789185722.793397:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898430592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185722.793420:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185722.793455:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898430592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185722.793468:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:1.0:1789185722.793505:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2c1324700 x1876096898430592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185722.793523:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898430592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185722.793580:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898428800:0@lo:400:kworker.0 00000100:00100000:1.0:1789185722.793593:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898429312:0@lo:400:kworker.0 00000100:00100000:1.0:1789185722.793603:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898429824:0@lo:400:kworker.0 00010000:00080000:1.0:1789185722.793613:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff985500 x1876096898430336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185722.793621:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898430336:0@lo:400:kworker.0 00000100:00100000:1.0:1789185722.793650:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898429056:0@lo:400:kworker.0 00000100:00100000:1.0:1789185722.793711:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185722.793718:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898430720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185722.793742:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185722.793773:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898430720 00000100:00100000:1.0:1789185722.793777:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898430720 00000100:00100000:1.0:1789185722.793801:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789185722.793806:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898430720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185722.793831:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789185722.793867:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898430720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185722.793873:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789185722.793962:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898430720:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789185722.794440:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185722.794446:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185722.794461:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898429184 00000100:00100000:2.0:1789185722.794466:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898429184 00000100:00100000:2.0:1789185722.794513:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789185722.794520:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898429184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185722.794566:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898429184:12345-0@lo:400:kworker.0 Request processed in 46us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185722.794572:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00002000:00000024:0.0:1789185722.794663:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185722.794714:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898430464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1836us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.794721:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:2.0:1789185722.794800:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f748a680 x1876096898430464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185722.794814:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f748a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898430464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185722.795052:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898429184:0@lo:400:kworker.0 00000100:00100000:3.0:1789185722.795075:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898429696:0@lo:400:kworker.0 00000100:00100000:3.0:1789185722.795298:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185722.795345:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898430208:0@lo:400:kworker.0 00000100:00100000:3.0:1789185722.795379:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185722.801093:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898429696 00000100:00100000:0.0:1789185722.801112:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898429696 00000100:00100000:0.0:1789185722.801210:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898430208 00000100:00100000:0.0:1789185722.801214:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898430208 00000100:00100000:1.0:1789185722.801465:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789185722.801480:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898429696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185722.801585:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898429696:12345-0@lo:400:kworker.0 Request processed in 109us (6287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185722.801593:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789185722.801680:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789185722.801687:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898430208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185722.801724:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898430208:12345-0@lo:400:kworker.0 Request processed in 39us (6345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185722.801730:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789185722.801931:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185722.801976:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898429696:0@lo:400:kworker.0 00010000:00080000:3.0:1789185722.801991:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff981c00 x1876096898430208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185722.802001:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898430208:0@lo:400:kworker.0 00010000:00010000:1.0:1789185723.686739:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185724.326351:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898430848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185724.326432:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185724.326556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898430848 00000100:00100000:0.0:1789185724.326564:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898430848 00000100:00100000:0.0:1789185724.326617:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789185724.326628:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898430848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185724.326661:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185724.326711:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898430848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185724.326719:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789185724.330825:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898430848:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185724.710159:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185725.350403:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898430976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185725.350487:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185725.350786:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898430976 00000100:00100000:1.0:1789185725.350796:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898430976 00000100:00080000:3.0:1789185725.351052:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185725.351102:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789185725.351113:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898430976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185725.351144:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185725.351203:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898430976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185725.351210:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789185725.351297:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898430976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185725.354468:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185725.356593:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898431104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185725.356684:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185725.356884:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898431104 00000100:00100000:0.0:1789185725.356894:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898431104 00000100:00100000:0.0:1789185725.357000:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789185725.357019:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898431104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185725.357045:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185725.357097:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898431104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185725.357105:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789185725.357267:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898431104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789185725.357589:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185725.734109:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185726.759310:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185727.783286:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185727.846013:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185727.846064:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185727.846112:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185727.846546:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879459968 00000100:00100000:3.0:1789185727.846559:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879459968 00000100:00100000:3.0:1789185727.846623:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879459840 00000100:00100000:3.0:1789185727.846626:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879459840 00000100:00100000:3.0:1789185727.846676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 281 00000100:00100000:3.0:1789185727.846688:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879459968:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185727.846708:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879459712 00000100:00100000:2.0:1789185727.846716:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879459712 00000100:00100000:2.0:1789185727.846757:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 380 00000100:00100000:2.0:1789185727.846767:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879459712:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185727.846793:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879459968:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 106us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185727.846801:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 281 00000100:00100000:2.0:1789185727.846807:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879459712:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 39us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185727.846816:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 380 00000100:00100000:3.0:1789185727.846838:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 282 00000100:00100000:3.0:1789185727.846847:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879459840:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185727.846872:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879459840:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 27us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185727.846879:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 282 00000100:00080000:2.0:1789185727.846881:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185727.846886:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185727.863308:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185727.863676:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879460096 00000100:00100000:2.0:1789185727.863695:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879460096 00000100:00100000:2.0:1789185727.863785:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:2.0:1789185727.863796:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2388:x1876096879460096:12345-192.168.204.48@tcp:9:kworker.0 00000020:00000080:2.0:1789185727.863834:0:9819:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72fa0 00000100:00080000:2.0:1789185727.863846:0:9819:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fe800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789185727.863899:0:9819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1789185727.864290:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+2:2388:x1876096879460096:12345-192.168.204.48@tcp:9:kworker.0 Request processed in 494us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185727.864299:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 27 00010000:00010000:3.0:1789185727.864945:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789185727.865222:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185727.865281:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185727.865607:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185727.866416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879460224 00000100:00100000:1.0:1789185727.866429:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879460224 00000100:00100000:1.0:1789185727.866509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879460352 00000100:00100000:1.0:1789185727.866513:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879460352 00000100:00100000:1.0:1789185727.866542:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 283 00000100:00100000:1.0:1789185727.866554:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879460224:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185727.866628:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879460224:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 76us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185727.866636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 283 00000100:00100000:1.0:1789185727.866668:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 284 00000100:00100000:1.0:1789185727.866675:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879460352:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185727.866703:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879460352:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 28us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185727.866709:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 284 00000100:00080000:0.0:1789185727.866813:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185727.866817:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185727.910421:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898431616:0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.910487:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185727.910547:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898432128:0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.910593:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185727.910616:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898432640:0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.910635:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185727.910663:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789185727.910669:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898431488:0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.910691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185727.910707:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898432000:0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.910737:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185727.910756:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898432512:0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.910774:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185727.910805:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898432128 00000100:00100000:0.0:1789185727.910813:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898432128 00000100:00100000:0.0:1789185727.910865:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898432640 00000100:00100000:0.0:1789185727.910869:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898432640 00000100:00100000:0.0:1789185727.910890:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789185727.910899:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898432128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.910993:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898432128:12345-0@lo:400:kworker.0 Request processed in 95us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185727.911001:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789185727.911017:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789185727.911023:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898432640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.911054:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898432640:12345-0@lo:400:kworker.0 Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185727.911059:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789185727.911075:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898431616 00000100:00100000:0.0:1789185727.911079:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898431616 00000100:00100000:0.0:1789185727.911102:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898432000 00000100:00100000:0.0:1789185727.911105:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898432000 00000100:00100000:0.0:1789185727.911121:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898432512 00000100:00100000:0.0:1789185727.911123:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898432512 00000100:00100000:0.0:1789185727.911137:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789185727.911143:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.911173:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898431616:12345-0@lo:400:kworker.0 Request processed in 30us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185727.911188:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789185727.911201:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789185727.911206:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898432000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.911232:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898432000:12345-0@lo:400:kworker.0 Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185727.911422:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789185727.911431:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898432512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185727.911471:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898432512:12345-0@lo:400:kworker.0 Request processed in 42us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185727.911476:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:2.0:1789185727.911520:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185727.911524:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185727.911526:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789185727.911562:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff987b80 x1876096898432000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185727.911576:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898432000:0@lo:400:kworker.0 00010000:00080000:2.0:1789185727.911585:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff985500 x1876096898432512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185727.911593:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898432512:0@lo:400:kworker.0 00000100:00100000:2.0:1789185727.911602:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898431616:0@lo:400:kworker.0 00000100:00100000:2.0:1789185727.911611:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898432128:0@lo:400:kworker.0 00010000:00080000:2.0:1789185727.911619:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff981c00 x1876096898432640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185727.911626:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898432640:0@lo:400:kworker.0 00000100:00100000:3.0:1789185727.911729:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898431232:0@lo:400:kworker.0 00000100:00100000:3.0:1789185727.911771:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185727.911811:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898431744:0@lo:400:kworker.0 00000100:00100000:3.0:1789185727.911836:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185727.911856:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898432256:0@lo:400:kworker.0 00000100:00100000:3.0:1789185727.911881:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185727.911898:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898432768:0@lo:400:kworker.0 00000100:00100000:3.0:1789185727.911943:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185727.911964:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789185727.911970:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898431360:0@lo:400:kworker.0 00000100:00100000:3.0:1789185727.911991:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185727.912007:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898431872:0@lo:400:kworker.0 00000100:00100000:3.0:1789185727.912028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185727.912052:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898432384:0@lo:400:kworker.0 00000100:00100000:3.0:1789185727.912071:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185727.912084:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898432896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185727.912103:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185727.912454:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898431488 00000100:00100000:1.0:1789185727.912461:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898431488 00000100:00100000:1.0:1789185727.912495:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898431744 00000100:00100000:1.0:1789185727.912499:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898431744 00000100:00100000:1.0:1789185727.912514:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789185727.912522:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898431488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185727.912575:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898431488:12345-0@lo:400:kworker.0 Request processed in 54us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185727.912582:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789185727.912598:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789185727.912605:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898431744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185727.912639:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898431744:12345-0@lo:400:kworker.0 Request processed in 35us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185727.912645:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789185727.912662:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898432256 00000100:00100000:1.0:1789185727.912665:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898432256 00000100:00100000:1.0:1789185727.912695:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898432768 00000100:00100000:1.0:1789185727.912698:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898432768 00000100:00100000:1.0:1789185727.912712:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789185727.912718:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898432256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185727.912747:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898432256:12345-0@lo:400:kworker.0 Request processed in 29us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185727.912763:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789185727.912775:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789185727.912781:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898432768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185727.912810:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898432768:12345-0@lo:400:kworker.0 Request processed in 29us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185727.912816:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789185727.912834:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898432896 00000100:00100000:1.0:1789185727.912837:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898432896 00000100:00100000:1.0:1789185727.912862:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789185727.912869:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898432896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185727.912892:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185727.912945:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898432896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185727.912952:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1789185727.913025:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185727.913028:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789185727.913058:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c2301f80 x1876096898432896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185727.913076:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898432896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185727.913111:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898431744:0@lo:400:kworker.0 00000100:00100000:1.0:1789185727.913121:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898432256:0@lo:400:kworker.0 00010000:00080000:1.0:1789185727.913132:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff980000 x1876096898432768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185727.915403:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789185727.915443:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898431872 00000100:00100000:0.0:1789185727.915451:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898431872 00000100:00100000:0.0:1789185727.915506:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898432384 00000100:00100000:0.0:1789185727.915509:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898432384 00000100:00100000:0.0:1789185727.915525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789185727.915533:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898431872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.915622:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898431872:12345-0@lo:400:kworker.0 Request processed in 90us (3592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185727.915628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789185727.915640:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789185727.915646:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898432384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.915677:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898432384:12345-0@lo:400:kworker.0 Request processed in 31us (3605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185727.915682:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:0.0:1789185727.915716:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185727.915758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898433152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185727.915798:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185727.915840:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898431488:0@lo:400:kworker.0 00000100:00100000:0.0:1789185727.915859:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185727.915881:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898433024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185727.915928:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185727.915956:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898433152 00000100:00100000:0.0:1789185727.915960:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898433152 00000100:00100000:0.0:1789185727.915986:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789185727.915992:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898433152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185727.916007:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185727.916040:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898433152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185727.916046:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789185727.916063:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898433024 00000100:00100000:0.0:1789185727.916067:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898433024 00000100:00100000:0.0:1789185727.916087:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789185727.916092:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898433024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185727.916116:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789185727.916144:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898433024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185727.916150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789185727.916178:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898433024:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1789185727.916190:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2c1326300 x1876096898433152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185727.916202:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898433152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185727.917266:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898431360 00000100:00100000:3.0:1789185727.917277:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898431360 00000100:00100000:3.0:1789185727.917326:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789185727.917334:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898431360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185727.917392:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898431360:12345-0@lo:400:kworker.0 Request processed in 59us (5400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185727.917398:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789185727.917561:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898432768:0@lo:400:kworker.0 00000100:00100000:1.0:1789185727.917631:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898431360:0@lo:400:kworker.0 00000100:00100000:1.0:1789185727.917643:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898431872:0@lo:400:kworker.0 00000100:00100000:1.0:1789185727.917653:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898432384:0@lo:400:kworker.0 00000100:00100000:2.0:1789185727.918825:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898431232 00000100:00100000:2.0:1789185727.918837:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898431232 00000100:00100000:2.0:1789185727.918937:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789185727.918947:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898431232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185727.919038:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898431232:12345-0@lo:400:kworker.0 Request processed in 94us (7267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185727.919061:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789185727.920118:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898431232:0@lo:400:kworker.0 00010000:00010000:0.0:1789185728.806111:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185729.446278:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898433280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185729.446357:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185729.446572:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898433280 00000100:00100000:0.0:1789185729.446581:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898433280 00000100:00100000:0.0:1789185729.446631:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789185729.446654:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898433280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185729.446689:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185729.446745:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898433280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185729.446752:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789185729.446904:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898433280:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185729.830777:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185730.470498:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185730.470524:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898433408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185730.470597:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185730.471129:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898433408 00000100:00100000:2.0:1789185730.471138:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898433408 00000100:00100000:2.0:1789185730.471220:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789185730.471231:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898433408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185730.471265:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185730.471318:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898433408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185730.471324:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789185730.471395:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185730.471429:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898433408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185730.471746:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185730.471757:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898433536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185730.471793:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185730.473012:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898433536 00000100:00100000:1.0:1789185730.473029:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898433536 00000100:00100000:1.0:1789185730.473117:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789185730.473127:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898433536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185730.473149:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185730.473235:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898433536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185730.473242:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1789185730.473325:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185730.473416:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898433536:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789185730.854272:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185731.879082:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789185732.396238:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789185732.396525:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789185732.905731:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185732.972884:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185732.972948:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185732.972977:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185732.973002:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185732.973025:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185732.973324:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879460608 00000100:00100000:3.0:1789185732.973338:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879460608 00000100:00100000:3.0:1789185732.973429:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879460864 00000100:00100000:3.0:1789185732.973434:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879460864 00000100:00100000:3.0:1789185732.974248:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879460736 00000100:00100000:3.0:1789185732.974257:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879460736 00000100:00100000:3.0:1789185732.974277:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879460992 00000100:00100000:3.0:1789185732.974281:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879460992 00000100:00100000:3.0:1789185732.974336:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 291 00000100:00100000:3.0:1789185732.974349:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879460608:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185732.974592:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879460608:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 244us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185732.974601:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 291 00000100:00100000:3.0:1789185732.974622:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 292 00000100:00100000:3.0:1789185732.974629:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879460864:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185732.974657:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879460864:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 29us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185732.974663:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 292 00000100:00100000:3.0:1789185732.974676:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 293 00000100:00100000:3.0:1789185732.974683:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879460736:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185732.974709:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879460736:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 27us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185732.974719:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 293 00000100:00100000:3.0:1789185732.974734:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 294 00000100:00100000:3.0:1789185732.974741:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879460992:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185732.974765:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879460992:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185732.974772:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 294 00000100:00100000:0.0:1789185732.975822:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879460480 00000100:00100000:0.0:1789185732.975836:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879460480 00000100:00100000:0.0:1789185732.975894:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 382 00000100:00100000:0.0:1789185732.975904:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879460480:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185732.975981:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879460480:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 79us (3003us total) trans 0 rc 0/0 00000100:00080000:1.0:1789185732.977080:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185732.977089:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185732.977239:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 382 00000100:00100000:2.0:1789185733.030861:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185733.030893:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898433664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185733.031026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185733.031094:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898433664 00000100:00100000:3.0:1789185733.031107:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898433664 00000100:00100000:2.0:1789185733.031242:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898433792:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031279:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185733.031307:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898434304:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.031339:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789185733.031339:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185733.031358:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898433664:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185733.031365:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898434816:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031397:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185733.031418:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789185733.031424:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898433920:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031450:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185733.031467:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898434432:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031490:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789185733.031493:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185733.031510:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898434944:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031556:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185733.031561:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898433664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 206us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185733.031572:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789185733.031594:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898434176:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031618:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185733.031645:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898434688:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031666:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185733.031686:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898435200:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031709:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185733.031730:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789185733.031737:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898434048:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185733.031780:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898434560:0@lo:400:kworker.0 00000100:00080000:1.0:1789185733.031789:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185733.031822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185733.031848:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898435072:0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.031869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185733.031893:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898433792 00000100:00100000:2.0:1789185733.031898:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898433792 00000100:00100000:2.0:1789185733.031958:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789185733.032253:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898433920 00000100:00100000:3.0:1789185733.032259:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898433920 00000100:00100000:3.0:1789185733.032286:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898434432 00000100:00100000:3.0:1789185733.032289:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898434432 00000100:00100000:3.0:1789185733.032311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898434944 00000100:00100000:3.0:1789185733.032314:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898434944 00000100:00100000:3.0:1789185733.032328:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898434176 00000100:00100000:3.0:1789185733.032331:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898434176 00000100:00100000:3.0:1789185733.032342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898434560 00000100:00100000:3.0:1789185733.032344:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898434560 00000100:00100000:3.0:1789185733.032356:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898435072 00000100:00100000:3.0:1789185733.032359:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898435072 00000100:00100000:3.0:1789185733.032375:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789185733.032383:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898433920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.033761:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898433792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.033887:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898433792:12345-0@lo:400:kworker.0 Request processed in 1919us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185733.033898:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789185733.033985:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898434304 00000100:00100000:2.0:1789185733.033994:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898434304 00000100:00100000:2.0:1789185733.034038:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898434048 00000100:00100000:2.0:1789185733.034042:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898434048 00000100:00100000:2.0:1789185733.034058:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789185733.034077:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898434304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.034121:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898434304:12345-0@lo:400:kworker.0 Request processed in 46us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185733.034127:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789185733.034151:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789185733.034158:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898434048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.034197:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898434048:12345-0@lo:400:kworker.0 Request processed in 40us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185733.034204:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789185733.034226:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898434816 00000100:00100000:2.0:1789185733.034230:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898434816 00000100:00100000:2.0:1789185733.034266:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898434688 00000100:00100000:2.0:1789185733.034270:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898434688 00000100:00100000:3.0:1789185733.034372:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898433920:12345-0@lo:400:kworker.0 Request processed in 1989us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185733.034382:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789185733.034401:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789185733.034409:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898434432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.034434:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898434432:12345-0@lo:400:kworker.0 Request processed in 27us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185733.034440:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789185733.034450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789185733.034456:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898434944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.034495:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898434944:12345-0@lo:400:kworker.0 Request processed in 40us (2939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185733.034503:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789185733.034515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789185733.034521:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.034548:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898434176:12345-0@lo:400:kworker.0 Request processed in 27us (2930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185733.034554:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789185733.034567:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789185733.034575:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898434560:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789185733.034602:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185733.034604:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898434560:12345-0@lo:400:kworker.0 Request processed in 31us (2783us total) trans 0 rc 0/0 00000100:00080000:1.0:1789185733.034611:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185733.034613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:1.0:1789185733.034617:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185733.034627:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789185733.034635:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898435072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.034663:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898435072:12345-0@lo:400:kworker.0 Request processed in 30us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185733.034669:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789185733.037464:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898435200 00000100:00100000:1.0:1789185733.037482:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898435200 00000100:00100000:1.0:1789185733.037561:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789185733.037574:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898434816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185733.037587:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789185733.037602:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898434688:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789185733.037944:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff981500 x1876096898433664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185733.037977:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898433664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185733.038084:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898434688:12345-0@lo:400:kworker.0 Request processed in 485us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185733.038095:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789185733.038125:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789185733.038135:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898435200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185733.038154:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898434816:12345-0@lo:400:kworker.0 Request processed in 581us (6754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185733.038164:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789185733.038188:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898435200:12345-0@lo:400:kworker.0 Request processed in 55us (6477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185733.038196:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1789185733.038218:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185733.040942:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898434048:0@lo:400:kworker.0 00010000:00080000:3.0:1789185733.040969:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff980700 x1876096898434560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185733.041459:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898434560:0@lo:400:kworker.0 00010000:00080000:3.0:1789185733.041482:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff985f80 x1876096898435072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185733.041492:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898435072:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.041507:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898434176:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.041522:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898434688:0@lo:400:kworker.0 00010000:00080000:3.0:1789185733.041534:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff985c00 x1876096898435200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185733.041542:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898435200:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.041620:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898435328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185733.043120:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185733.044434:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898433920:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.044458:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898434432:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.044471:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898434944:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.044485:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898433792:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.044501:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898434304:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.044516:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898434816:0@lo:400:kworker.0 00000100:00100000:3.0:1789185733.044576:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185733.044591:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898435456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185733.044683:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185733.045968:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898435456 00000100:00100000:0.0:1789185733.045996:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898435456 00000100:00100000:0.0:1789185733.046083:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789185733.046096:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898435456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185733.047582:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789185733.047713:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898435456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1615us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185733.047723:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789185733.047940:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898435456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185733.048362:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898435328 00000100:00100000:3.0:1789185733.048372:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898435328 00000100:00100000:3.0:1789185733.048432:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789185733.048445:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898435328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185733.048472:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185733.048606:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898435328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (5493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185733.048614:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:0.0:1789185733.050416:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2c1325180 x1876096898435328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185733.050446:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898435328:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1789185733.558216:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:3.0:1789185733.558231:0:8423:0:(genops.c:885:class_export_put()) final put ffff98f1c30fd000/f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:0.0:1789185733.558340:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c30fd000/f993ea83-7802-4340-a17e-bffdbb8158b1 for lustre-OST0000 00000020:00000080:0.0:1789185733.558427:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c30fe800 for lustre-OST0000 00010000:00010000:3.0:1789185733.926887:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185734.566242:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898435584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185734.566315:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185734.566444:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898435584 00000100:00100000:1.0:1789185734.566455:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898435584 00000100:00100000:1.0:1789185734.566508:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789185734.566518:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898435584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185734.566554:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185734.566611:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898435584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185734.566618:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789185734.566707:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898435584:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789185734.952016:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185735.591290:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898435712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185735.591371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185735.591543:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185735.591557:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898435840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185735.591591:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185735.591633:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898435712 00000100:00100000:1.0:1789185735.591643:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898435712 00000100:00100000:1.0:1789185735.591704:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898435840 00000100:00100000:1.0:1789185735.591707:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898435840 00000100:00100000:1.0:1789185735.591726:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789185735.591734:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898435712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185735.591955:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185735.592218:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898435712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 483us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185735.592227:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789185735.592247:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789185735.592253:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898435840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185735.592284:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185735.592316:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898435840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185735.592333:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1789185735.592350:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185735.592389:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898435840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185735.592885:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898435712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789185735.974040:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185737.001195:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789185737.578427:0:14071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:02:16 (1789185736) 00010000:00010000:3.0:1789185738.027754:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185738.087066:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185738.087176:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185738.087196:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185738.087255:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879461120 00000100:00100000:0.0:1789185738.087267:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879461120 00000100:00100000:0.0:1789185738.087333:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 384 00000100:00100000:0.0:1789185738.087343:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879461120:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185738.087421:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879461120:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.087429:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 384 00000100:00100000:1.0:1789185738.092969:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185738.097271:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879461248 00000100:00100000:3.0:1789185738.097287:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879461248 00000100:00100000:3.0:1789185738.097522:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879461376 00000100:00100000:3.0:1789185738.097527:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879461376 00000100:00100000:1.0:1789185738.102179:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879461632 00000100:00100000:1.0:1789185738.102194:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879461632 00000100:00080000:2.0:1789185738.102263:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185738.102289:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 301 00000100:00100000:2.0:1789185738.102303:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879461248:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185738.102413:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879461248:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 114us (15435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185738.102422:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 301 00000100:00080000:2.0:1789185738.102453:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185738.102532:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185738.102666:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879461504 00000100:00100000:2.0:1789185738.102671:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879461504 00000100:00100000:2.0:1789185738.102712:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 302 00000100:00100000:2.0:1789185738.102719:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879461504:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185738.102753:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879461504:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185738.102759:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 302 00000100:00080000:2.0:1789185738.102796:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185738.107373:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 303 00000100:00100000:3.0:1789185738.107405:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879461376:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185738.107495:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879461376:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 96us (20298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185738.107502:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 303 00000100:00100000:1.0:1789185738.108816:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 304 00000100:00100000:1.0:1789185738.108830:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879461632:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185738.108903:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879461632:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 75us (15943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185738.108926:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 304 00000100:00100000:3.0:1789185738.150367:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898435968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185738.150445:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185738.151899:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898436352:0@lo:400:kworker.0 00000100:00100000:2.0:1789185738.151981:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185738.152036:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789185738.152053:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898436480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185738.152077:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185738.152107:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898436224:0@lo:400:kworker.0 00000100:00100000:2.0:1789185738.152132:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185738.152154:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185738.152159:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898436096:0@lo:400:kworker.0 00000100:00100000:2.0:1789185738.152187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185738.152222:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898436096 00000100:00100000:2.0:1789185738.152230:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898436096 00000100:00100000:2.0:1789185738.152273:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789185738.152293:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898436096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185738.152344:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898436096:12345-0@lo:400:kworker.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185738.152351:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789185738.152394:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898436096:0@lo:400:kworker.0 00000100:00100000:2.0:1789185738.152420:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898436224 00000100:00100000:2.0:1789185738.152423:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898436224 00000100:00100000:2.0:1789185738.152448:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789185738.152453:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898436224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185738.152482:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898436224:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185738.152488:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789185738.152509:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898436224:0@lo:400:kworker.0 00000100:00100000:2.0:1789185738.152543:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898436352 00000100:00100000:2.0:1789185738.152546:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898436352 00000100:00100000:2.0:1789185738.152565:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898436480 00000100:00100000:2.0:1789185738.152567:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898436480 00000100:00100000:2.0:1789185738.152576:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789185738.152581:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1876096898436352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185738.152611:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1876096898436352:12345-0@lo:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185738.152617:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789185738.152627:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789185738.152632:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898436480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185738.152653:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789185738.152686:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898436480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185738.152692:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789185738.152738:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898435968 00000100:00100000:2.0:1789185738.152741:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898435968 00000100:00100000:2.0:1789185738.152770:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789185738.152775:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898435968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789185738.152794:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185738.156516:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898436608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185738.156593:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.156648:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898437120:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.156671:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.156686:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898437632:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.156703:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.156721:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789185738.156726:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898436736:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.156744:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.156759:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898437248:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.156778:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.156790:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898437760:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.156804:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.156832:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898436864:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.156852:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.156868:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898437376:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.156885:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.156949:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898436480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185738.156960:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898436352:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.156977:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789185738.156992:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898436992:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157014:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.157030:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898437504:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157064:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185738.157102:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898437120 00000100:00100000:0.0:1789185738.157109:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898437120 00000100:00100000:0.0:1789185738.157151:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898437632 00000100:00100000:0.0:1789185738.157155:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898437632 00000100:00100000:0.0:1789185738.157167:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898436736 00000100:00100000:0.0:1789185738.157170:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898436736 00000100:00100000:0.0:1789185738.157180:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898436992 00000100:00100000:0.0:1789185738.157183:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898436992 00000100:00100000:0.0:1789185738.157193:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898437504 00000100:00100000:0.0:1789185738.157195:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898437504 00000100:00100000:0.0:1789185738.157211:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789185738.157220:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898437120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157270:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898437120:12345-0@lo:400:kworker.0 Request processed in 50us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.157277:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00080000:0.0:1789185738.157306:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2d2fd1180 x1876096898437120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185738.157317:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898437120:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157331:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789185738.157336:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898437632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157364:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898437632:12345-0@lo:400:kworker.0 Request processed in 28us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.157370:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00080000:0.0:1789185738.157388:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff9aa680 x1876096898437632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185738.157397:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898437632:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157411:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789185738.157424:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898436736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157456:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898436736:12345-0@lo:400:kworker.0 Request processed in 33us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.157462:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789185738.157485:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898436736:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157500:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789185738.157506:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898436992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157537:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898436992:12345-0@lo:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.157542:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789185738.157563:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898436992:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157579:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789185738.157585:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898437504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157615:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898437504:12345-0@lo:400:kworker.0 Request processed in 30us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.157620:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789185738.157639:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898437504:0@lo:400:kworker.0 00000100:00080000:0.0:1789185738.157657:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185738.157661:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185738.157663:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185738.157688:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898437248 00000100:00100000:0.0:1789185738.157692:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898437248 00000100:00100000:0.0:1789185738.157717:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898437760 00000100:00100000:0.0:1789185738.157720:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898437760 00000100:00100000:0.0:1789185738.157731:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898437376 00000100:00100000:0.0:1789185738.157733:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898437376 00000100:00100000:0.0:1789185738.157755:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789185738.157761:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898437248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157795:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898437248:12345-0@lo:400:kworker.0 Request processed in 34us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.157801:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789185738.157811:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789185738.157817:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898437760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157842:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898437760:12345-0@lo:400:kworker.0 Request processed in 25us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.157848:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789185738.157857:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789185738.157863:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898437376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157889:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898437376:12345-0@lo:400:kworker.0 Request processed in 27us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.157895:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789185738.157946:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898437248:0@lo:400:kworker.0 00010000:00080000:0.0:1789185738.157956:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff9a8e00 x1876096898437760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185738.157964:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898437760:0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.157984:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898437376:0@lo:400:kworker.0 00000100:00080000:0.0:1789185738.157998:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185738.158000:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185738.158034:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898436608 00000100:00100000:0.0:1789185738.158037:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898436608 00000100:00100000:0.0:1789185738.158074:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789185738.158088:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898436608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185738.158101:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185738.158132:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898436608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.158138:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:0.0:1789185738.158162:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2d2fd4000 x1876096898436608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185738.158175:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898436608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185738.158195:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898436864 00000100:00100000:0.0:1789185738.158199:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898436864 00000100:00100000:0.0:1789185738.158221:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789185738.158227:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898436864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185738.158261:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898436864:12345-0@lo:400:kworker.0 Request processed in 34us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185738.158267:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789185738.158291:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898436864:0@lo:400:kworker.0 00000100:00100000:2.0:1789185738.163252:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898435968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10467us (12797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185738.163268:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:3.0:1789185738.168553:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2d2fd5500 x1876096898435968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185738.168584:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898435968:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789185739.047343:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185739.687062:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185739.687092:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898437888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185739.687171:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185739.687613:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898437888 00000100:00100000:1.0:1789185739.687622:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898437888 00000100:00100000:1.0:1789185739.687679:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789185739.687689:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898437888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185739.687738:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185739.687808:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898437888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185739.687815:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789185739.687925:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898437888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185739.758323:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185739.758415:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879461760 00000100:00100000:0.0:1789185739.758428:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879461760 00000100:00100000:0.0:1789185739.758512:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 40 00000100:00100000:0.0:1789185739.758524:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:11083:x1876096879461760:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185739.758547:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185739.758602:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51dd8 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185739.758682:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73087 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185739.758712:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185739.758726:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185739.758778:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789185739.758781:0:8147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185739.758820:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185739.758847:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dd8 expref: 7 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185739.758868:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dd8 expref: 6 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185739.758876:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2900) 00010000:00010000:0.0:1789185739.758879:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185739.758884:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031e00, rc 0) 00000100:00100000:0.0:1789185739.759024:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:11083:x1876096879461760:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 489us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185739.759032:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 40 00000100:00100000:0.0:1789185739.766558:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185739.768847:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879461888 00000100:00100000:2.0:1789185739.768863:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879461888 00000100:00100000:2.0:1789185739.769072:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:2.0:1789185739.769085:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+6:11084:x1876096879461888:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185739.769111:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185739.769143:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7308e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ddf expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769226:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769241:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769253:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769300:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769308:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769315:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769386:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a730a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769394:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a730a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769402:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a730a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185739.769461:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789185739.769466:0:9473:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185739.769491:0:9473:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a730a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769503:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769509:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769517:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769533:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185739.769537:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769545:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769557:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2900) 00010000:00010000:2.0:1789185739.769560:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185739.769566:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769571:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769587:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769593:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769599:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769604:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185739.769607:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769613:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769632:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98f1c33d9a00) 00010000:00010000:2.0:1789185739.769634:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185739.769637:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769643:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7309c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769677:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7308e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ddf expref: 8 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769690:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a730a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ddf expref: 7 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.769696:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f1c33d9d00) 00010000:00010000:2.0:1789185739.769698:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185739.769701:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde200, rc 0) 00000100:00100000:2.0:1789185739.769785:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+7:11084:x1876096879461888:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 702us (3240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185739.769792:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:3.0:1789185739.775608:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185739.775777:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879462016 00000100:00100000:1.0:1789185739.775792:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879462016 00000100:00100000:1.0:1789185739.775878:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:1.0:1789185739.775892:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:11084:x1876096879462016:12345-192.168.204.48@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789185739.776110:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:11084:x1876096879462016:12345-192.168.204.48@tcp:900:lhsmtool_posix.0 Request processed in 220us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185739.776119:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:3.0:1789185739.800391:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185739.800534:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879462272 00000100:00100000:2.0:1789185739.800560:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879462272 00000100:00100000:2.0:1789185739.800662:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:2.0:1789185739.800673:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:11084:x1876096879462272:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185739.800697:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185739.800720:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a730aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51de6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.800838:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.800853:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.800866:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.800961:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.800968:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.800975:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801098:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a730bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801106:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a730bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801113:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a730bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185739.801122:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789185739.801214:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801221:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801233:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801239:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185739.801243:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801251:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801618:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f1c33d9d00) 00010000:00010000:2.0:1789185739.801622:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185739.801628:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801635:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a730b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801650:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801656:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801662:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801667:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185739.801670:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801689:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801697:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98f1c33d9a00) 00010000:00010000:2.0:1789185739.801699:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185739.801702:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185739.801708:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a730b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185739.804598:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a730aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51de6 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185739.804639:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a730bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51de6 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185739.804650:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:3.0:1789185739.804653:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185739.804658:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf200, rc 0) 00000100:00100000:3.0:1789185739.804766:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+9:11084:x1876096879462272:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 4093us (4391us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789185739.804795:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:1.0:1789185739.812555:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185739.812751:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879462400 00000100:00100000:0.0:1789185739.812763:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879462400 00000100:00100000:0.0:1789185739.812831:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 43 00000100:00100000:0.0:1789185739.812843:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+9:11084:x1876096879462400:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789185739.813035:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+9:11084:x1876096879462400:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 Request processed in 193us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185739.813045:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 43 00000100:00100000:1.0:1789185739.816515:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185739.816687:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879462528 00000100:00100000:2.0:1789185739.816703:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879462528 00000100:00100000:2.0:1789185739.816783:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 44 00000100:00100000:2.0:1789185739.816795:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:11084:x1876096879462528:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789185739.820438:0:9473:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3580us 00000100:00100000:2.0:1789185739.859491:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:11084:x1876096879462528:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 Request processed in 42679us (42973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185739.859512:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 44 00010000:00010000:3.0:1789185740.071179:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789185740.582739:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789185740.583806:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789185740.710403:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185740.710434:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898438016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185740.710533:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185740.710818:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898438016 00000100:00100000:3.0:1789185740.710829:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898438016 00000100:00100000:3.0:1789185740.711220:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789185740.711235:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898438016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185740.711278:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185740.711375:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898438016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185740.711384:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789185740.711452:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898438016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185740.717890:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898438144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185740.718059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185740.718165:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898438144 00000100:00100000:1.0:1789185740.718176:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898438144 00000100:00080000:0.0:1789185740.721153:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185740.721407:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789185740.721425:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898438144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185740.721466:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185740.721602:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898438144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 183us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185740.721610:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789185740.721708:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898438144:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789185741.094348:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185742.118114:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185742.151028:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.151162:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879462656 00000100:00100000:1.0:1789185742.151173:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879462656 00000100:00100000:1.0:1789185742.151259:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 45 00000100:00100000:1.0:1789185742.151271:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+9:11126:x1876096879462656:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185742.151294:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185742.151318:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a730cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ded expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151393:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151409:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151433:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151448:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151456:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151462:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151508:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151515:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151522:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151527:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185742.151531:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151538:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151549:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2900) 00010000:00010000:1.0:1789185742.151552:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185742.151557:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151588:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a730d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151604:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151610:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151616:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151621:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185742.151624:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789185742.151726:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185742.151799:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151812:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98f300ff1200) 00010000:00010000:1.0:1789185742.151815:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185742.151818:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151824:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a730db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151859:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a730cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ded expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151881:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2900) 00010000:00010000:1.0:1789185742.151884:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185742.151888:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a730cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ded expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.151898:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8400, rc 0) 00000100:00100000:1.0:1789185742.152014:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+9:11126:x1876096879462656:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 746us (997us total) trans 0 rc 301/301 00000100:00100000:1.0:1789185742.152022:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 45 00000100:00100000:0.0:1789185742.157671:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185742.157759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879462912 00000100:00100000:2.0:1789185742.157769:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879462912 00000100:00100000:2.0:1789185742.157835:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 46 00000100:00100000:2.0:1789185742.157847:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+9:11126:x1876096879462912:12345-192.168.204.48@tcp:36:lfs.0 00010000:00010000:2.0:1789185742.157947:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185742.158007:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73087 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dd8 expref: 9 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158028:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2900) 00010000:00010000:2.0:1789185742.158041:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185742.158113:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158126:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158136:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158148:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158155:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158161:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158628:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158638:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158645:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185742.158659:0:6514:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000af9820e1 reply state 00000000c18181a6 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158678:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158684:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185742.158687:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185742.158690:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789185742.158695:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789185742.158705:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158711:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158718:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158723:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185742.158727:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158734:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158742:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2fae07300) 00010000:00010000:2.0:1789185742.158745:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185742.158748:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158753:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a730e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185742.158768:0:6514:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000af9820e1 reply state 00000000c18181a6 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158783:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.158789:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98f2fae07000) 00010000:00010000:2.0:1789185742.158791:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185742.158793:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789185742.158887:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+10:11126:x1876096879462912:12345-192.168.204.48@tcp:36:lfs.0 Request processed in 1041us (1226us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789185742.158895:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 46 00000100:00100000:2.0:1789185742.262530:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185742.264349:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879463040 00000100:00100000:0.0:1789185742.264365:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879463040 00000100:00100000:0.0:1789185742.264560:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 47 00000100:00100000:0.0:1789185742.264637:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+10:11134:x1876096879463040:12345-192.168.204.48@tcp:101:lctl.0 00010000:00010000:0.0:1789185742.264665:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185742.264766:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a730f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51df4 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.264834:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a730fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.264848:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a730fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.264860:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a730fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185742.264936:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789185742.264941:0:9473:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185742.265068:0:9473:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a730fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.265116:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a730f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51df4 expref: 12 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.265135:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a730fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51df4 expref: 11 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.265143:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2800) 00010000:00010000:0.0:1789185742.265145:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185742.265149:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0030800, rc 0) 00000100:00100000:0.0:1789185742.265322:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+11:11134:x1876096879463040:12345-192.168.204.48@tcp:101:lctl.0 Request processed in 689us (2803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185742.272882:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 47 00000100:00100000:3.0:1789185742.322602:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185742.322825:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879463168 00000100:00100000:0.0:1789185742.322841:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879463168 00000100:00100000:2.0:1789185742.322953:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 48 00000100:00100000:2.0:1789185742.323057:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+11:11140:x1876096879463168:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185742.323240:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185742.323263:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51dfb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323329:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323343:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323372:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323383:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323390:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323395:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323473:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30daa00/0xda5c730d5a7311a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323481:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30daa00/0xda5c730d5a7311a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323487:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30daa00/0xda5c730d5a7311a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185742.323524:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789185742.323528:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789185742.323587:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30daa00/0xda5c730d5a7311a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323602:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323609:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323626:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323632:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185742.323636:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323645:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323657:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2800) 00010000:00010000:3.0:1789185742.323660:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185742.323665:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323671:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7310c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323685:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323691:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323697:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323703:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185742.323706:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323724:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323732:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98f2fae07000) 00010000:00010000:3.0:1789185742.323734:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185742.323738:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323743:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73113 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323774:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dfb expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323787:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30daa00/0xda5c730d5a7311a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dfb expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.323793:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:3.0:1789185742.323795:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789185742.323798:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30daa00, rc 0) 00000100:00100000:3.0:1789185742.324009:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+12:11140:x1876096879463168:12345-192.168.204.48@tcp:101:bash.0 Request processed in 1045us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185742.327649:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 48 00000100:00100000:1.0:1789185742.335987:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185742.337593:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879463424 00000100:00100000:0.0:1789185742.337610:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879463424 00000100:00100000:0.0:1789185742.337693:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 49 00000100:00100000:0.0:1789185742.337705:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+12:11140:x1876096879463424:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185742.337727:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185742.337749:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73121 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e02 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.337864:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.337879:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.337942:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.337975:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.337983:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.337990:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789185742.338325:0:8147:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789185742.338464:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338473:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338481:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338512:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338520:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338527:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338533:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185742.338544:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338551:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338563:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:0.0:1789185742.338566:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185742.338571:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338578:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73128 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789185742.338591:0:8147:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a7a7a898 reply state 00000000f1b13b33 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338601:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338606:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f1c33e2700) 00010000:00010000:0.0:1789185742.338608:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789185742.338611:0:8147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789185742.338643:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73121 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e02 expref: 15 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338659:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e02 expref: 14 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.338666:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f1c33e2500) 00010000:00010000:0.0:1789185742.338668:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185742.338677:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dbc00, rc 0) 00000100:00100000:0.0:1789185742.338754:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+15:11140:x1876096879463424:12345-192.168.204.48@tcp:101:bash.0 Request processed in 1051us (2792us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789185742.338762:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 49 00000100:00100000:2.0:1789185742.347843:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185742.347992:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879463552 00000100:00100000:0.0:1789185742.348006:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879463552 00000100:00100000:0.0:1789185742.348079:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:0.0:1789185742.348089:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876096879463552:12345-192.168.204.48@tcp:8:bash.0 00010000:00080000:0.0:1789185742.348130:0:9819:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:0.0:1789185742.348169:0:9819:0:(genops.c:1384:class_connect()) connect: client f993ea83-7802-4340-a17e-bffdbb8158b1, cookie 0xda5c730d5a73144 00002000:00100000:0.0:1789185742.348183:0:9819:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f993ea83-7802-4340-a17e-bffdbb8158b1/ffff98f1c365d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789185742.348205:0:9819:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789185742.348301:0:9819:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789185742.348336:0:9819:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fe800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185742.348401:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2388:x1876096879463552:12345-192.168.204.48@tcp:8:bash.0 Request processed in 312us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185742.348409:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:3.0:1789185742.353394:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185742.353506:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879463680 00000100:00100000:0.0:1789185742.353516:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879463680 00000100:00100000:0.0:1789185742.353600:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00100000:0.0:1789185742.353609:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:0:x1876096879463680:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185742.353625:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185742.353650:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e09 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789185742.353678:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789185742.353713:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1789185742.353718:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185742.353727:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e09 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.353754:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e09 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.353766:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db800, rc 0) 00000100:00100000:0.0:1789185742.353823:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:0:x1876096879463680:12345-192.168.204.48@tcp:101:bash.0 Request processed in 216us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185742.353831:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00080000:1.0:1789185742.354411:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185742.357767:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185742.357859:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879463808 00000100:00100000:0.0:1789185742.357870:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879463808 00000100:00100000:0.0:1789185742.357951:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 30 00000100:00100000:0.0:1789185742.357974:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:11140:x1876096879463808:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185742.357992:0:9819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185742.358012:0:9819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e10 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.358050:0:9819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e09 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.358060:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185742.358065:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185742.358072:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 8 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.358126:0:9819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e09 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.358141:0:9819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e09 expref: 8 pid: 8427 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185742.358155:0:9819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9819:1876096898438272:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185742.358260:0:9819:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185742.364229:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185742.364296:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879463936 00000100:00100000:2.0:1789185742.364305:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879463936 00010000:00010000:2.0:1789185742.364342:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e09 expref: 9 pid: 8427 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185742.364384:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:2.0:1789185742.364393:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879463936:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185742.364408:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185742.364430:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e09 expref: 9 pid: 8427 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.364443:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e09 expref: 9 pid: 8427 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.364484:0:10394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185742.364489:0:10394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185742.364496:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 9 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.364506:0:10394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 9 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.364547:0:10394:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 9 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185742.364561:0:10394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10394:1876096898438400:192.168.204.48@tcp:105: 00000100:00100000:2.0:1789185742.364780:0:10394:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f28fe0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789185742.364868:0:9819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a7314b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e09 expref: 9 pid: 8427 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185742.364887:0:9819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9819:1876096898438272:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185742.364952:0:9819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 8 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.364974:0:9819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db600, rc 0) 00000100:00100000:1.0:1789185742.365005:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+8:11140:x1876096879463808:12345-192.168.204.48@tcp:101:bash.0 Request processed in 7045us (7254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185742.365013:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 30 00000100:00100000:2.0:1789185742.372708:0:10394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10394:1876096898438400:192.168.204.48@tcp:105: 00010000:00010000:2.0:1789185742.372736:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185742.372819:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879463936:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 8425us (8597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185742.372832:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:0.0:1789185742.377095:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185742.377189:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879464192 00000100:00100000:3.0:1789185742.377208:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879464192 00000100:00100000:3.0:1789185742.377356:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:3.0:1789185742.377372:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+15:11140:x1876096879464192:12345-192.168.204.48@tcp:35:bash.0 00000100:00100000:3.0:1789185742.378062:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11140:x1876096879464192:12345-192.168.204.48@tcp:35:bash.0 Request processed in 690us (973us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789185742.381217:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:0.0:1789185742.475394:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.476096:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879464448 00000100:00100000:1.0:1789185742.476133:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879464448 00000100:00100000:1.0:1789185742.476216:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 50 00000100:00100000:1.0:1789185742.476228:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11150:x1876096879464448:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185742.476257:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185742.476280:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73159 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e17 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185742.476404:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789185742.476517:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73159 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e17 expref: 18 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.476536:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2800) 00010000:00010000:1.0:1789185742.476539:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185742.476546:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73159 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e17 expref: 18 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.477367:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9400, rc 0) 00000100:00100000:2.0:1789185742.480296:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11150:x1876096879464448:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 4057us (4909us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1789185742.480310:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 50 00000100:00100000:2.0:1789185742.490106:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.490222:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879464704 00000100:00100000:1.0:1789185742.490234:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879464704 00000100:00100000:1.0:1789185742.490432:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:1.0:1789185742.490445:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11150:x1876096879464704:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:1.0:1789185742.490761:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11150:x1876096879464704:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 317us (664us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789185742.490769:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:0.0:1789185742.581747:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185742.582617:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879464832 00000100:00100000:3.0:1789185742.582632:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879464832 00000100:00100000:3.0:1789185742.582702:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:3.0:1789185742.582711:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11156:x1876096879464832:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185742.582738:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185742.582759:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e1e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.582827:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7316e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.582844:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7316e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.582857:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7316e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185742.582903:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789185742.583091:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789185742.583177:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7316e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.583211:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e1e expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.583231:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7316e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e1e expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.583262:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:3.0:1789185742.583265:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789185742.583269:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da000, rc 0) 00000100:00100000:3.0:1789185742.583716:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+19:11156:x1876096879464832:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1003us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185742.583725:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:0.0:1789185742.591144:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185742.591398:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879465088 00000100:00100000:2.0:1789185742.591410:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879465088 00000100:00100000:2.0:1789185742.591495:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:2.0:1789185742.591506:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+19:11156:x1876096879465088:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185742.591529:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185742.591552:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73175 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e25 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.591682:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7317c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.591697:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7317c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.591710:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7317c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185742.591722:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789185742.591833:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73175 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e25 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.591850:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7317c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e25 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.591858:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f1c33e2500) 00010000:00010000:2.0:1789185742.591862:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185742.591866:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf000, rc 0) 00000100:00100000:2.0:1789185742.591992:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:11156:x1876096879465088:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 487us (860us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789185742.592000:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:2.0:1789185742.598076:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.598246:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879465344 00000100:00100000:1.0:1789185742.598257:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879465344 00000100:00100000:1.0:1789185742.598328:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:1.0:1789185742.598341:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+21:2391:x1876096879465344:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185742.598377:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185742.598402:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7317c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e25 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.598421:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f1c33e2500) 00010000:00010000:1.0:1789185742.598426:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185742.598486:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+20:2391:x1876096879465344:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 148us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185742.598493:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:1.0:1789185742.607404:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185742.608186:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879465472 00000100:00100000:2.0:1789185742.608198:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879465472 00000100:00100000:2.0:1789185742.608271:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 53 00000100:00100000:2.0:1789185742.608282:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+20:11156:x1876096879465472:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185742.608319:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185742.608343:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7318a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e2c expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.608471:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73191 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.608487:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.608499:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185742.608512:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789185742.608629:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7318a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e2c expref: 23 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.608650:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73191 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e2c expref: 22 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.608659:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f1c33e2500) 00010000:00010000:2.0:1789185742.608662:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789185742.608666:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddfa00, rc 0) 00000100:00100000:2.0:1789185742.608749:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11156:x1876096879465472:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 469us (1355us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789185742.609044:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 53 00000100:00100000:0.0:1789185742.621733:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.621933:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879465600 00000100:00100000:1.0:1789185742.621944:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879465600 00000100:00100000:1.0:1789185742.622018:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:1.0:1789185742.622029:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879465600:12345-192.168.204.48@tcp:1:lfs.0 00010000:00010000:1.0:1789185742.622077:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.622099:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 7 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.622125:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185742.622129:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185742.622133:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.622170:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 7 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.622199:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 7 pid: 9819 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185742.622215:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1876096898438528:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185742.622310:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3010199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185742.629653:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1876096898438528:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185742.629689:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185742.630582:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789185742.632518:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789185742.635460:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.635631:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879465728 00000100:00100000:1.0:1789185742.635642:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879465728 00002000:00100000:1.0:1789185742.635701:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff98f2d2fd4380 x1876096879465728/t0(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:343/0 lens 504/0 e 0 to 0 dl 1789185753 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185742.635714:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f2d2fd4380 with x1876096879465728 ext(0->12) 00010000:00010000:1.0:1789185742.635725:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 8 pid: 9819 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.635747:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 8 pid: 9819 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185742.635756:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f2d2fd4380 00000100:00100000:1.0:1789185742.635847:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:1.0:1789185742.635858:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879465728:12345-192.168.204.48@tcp:4:lfs.0 00000001:00100000:0.0:1789185742.638497:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000100:00100000:2.0:1789185742.640569:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2392:x1876096879465728:12345-192.168.204.48@tcp:4:lfs.0 Request processed in 4701us (5245us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789185742.640591:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 0 00002000:00100000:2.0:1789185742.640606:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff98f2d2fd4380 x1876096879465728/t4294967300(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:343/0 lens 504/448 e 0 to 0 dl 1789185753 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185742.640617:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f2d2fd4380 with x1876096879465728 ext(0->12) 00010000:00010000:2.0:1789185742.640629:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 9 pid: 9819 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.640648:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 9 pid: 9819 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185742.640656:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f2d2fd4380 00000100:00100000:3.0:1789185742.650875:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185742.651151:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879465856 00000100:00100000:2.0:1789185742.651163:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879465856 00010000:00010000:2.0:1789185742.651214:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 9 pid: 9819 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185742.651263:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 53 00000100:00100000:2.0:1789185742.651273:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2390:x1876096879465856:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185742.651289:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789185742.651308:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789185742.651326:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789185742 00002000:00010000:2.0:1789185742.651328:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789185742 00002000:00010000:2.0:1789185742.651330:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789185742 00002000:00010000:2.0:1789185742.651332:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789185742.651341:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 9 pid: 9819 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.651366:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 9 pid: 9819 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.651390:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a20e35f/0xda5c730d5a73152 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e10 expref: 9 pid: 9819 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.651411:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185742.651415:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185742.651420:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.651430:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.651528:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185742.651895:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2390:x1876096879465856:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 622us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185742.651903:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 53 00010000:00010000:1.0:1789185742.654855:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.654878:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.655549:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.655562:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.655570:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.655576:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185742.655581:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.655590:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.655616:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.655635:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045402116/0xda5c730d5a7319f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185742.655764:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879465600:12345-192.168.204.48@tcp:1:lfs.0 Request processed in 33731us (34038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185742.655774:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:0.0:1789185742.660743:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.660824:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879466112 00000100:00100000:1.0:1789185742.660837:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879466112 00000100:00100000:1.0:1789185742.660897:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:1.0:1789185742.661134:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11156:x1876096879466112:12345-192.168.204.48@tcp:35:lfs.0 00000004:00010000:1.0:1789185742.661202:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73191 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e2c expref: 22 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185742.663227:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1789185742.663295:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789185742.667899:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1789185742.668215:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.668238:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e02 expref: 26 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.668248:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.668486:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e02 expref: 26 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.668506:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e02 expref: 26 pid: 8147 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185742.668717:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876096898438656:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185742.669398:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185742.676276:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876096898438656:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185742.676312:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185742.682480:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.685674:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879466240 00000100:00100000:1.0:1789185742.685691:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879466240 00010000:00010000:0.0:1789185742.685938:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e02 expref: 27 pid: 8147 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185742.686001:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 54 00000100:00100000:0.0:1789185742.686012:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+27:2389:x1876096879466240:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185742.686027:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185742.686033:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e02 expref: 27 pid: 8147 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.686046:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e02 expref: 27 pid: 8147 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.686070:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73136 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e02 expref: 27 pid: 8147 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.686089:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f1c33e2500) 00010000:00010000:0.0:1789185742.686107:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.686118:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.686125:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.686170:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185742.686261:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+26:2389:x1876096879466240:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 249us (3792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185742.686269:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 54 00010000:00010000:1.0:1789185742.686348:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.686357:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185742.686488:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1789185742.686622:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1789185742.686723:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876096898438784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789185742.686785:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185742.686819:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7fcc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789185742.687569:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898438784 00000100:00100000:0.0:1789185742.687579:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898438784 00000100:00100000:0.0:1789185742.687631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789185742.687640:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1876096898438784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789185742.687769:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1876096898438784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185742.687777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789185742.688949:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876096898438784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789185742.689307:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1789185742.689389:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876096898438912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789185742.689442:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185742.689473:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185742.689751:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898438912 00000100:00100000:1.0:1789185742.689759:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898438912 00000100:00100000:1.0:1789185742.689816:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789185742.689826:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1876096898438912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789185742.690014:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1876096898438912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 189us (571us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789185742.690022:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1789185742.690046:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185742.690073:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876096898438912:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789185742.690117:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789185742.690166:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.690176:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.690186:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.690191:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185742.690196:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.690204:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.690222:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f1c33e2500) 00010000:00010000:1.0:1789185742.690234:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789185742.690240:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185742.690246:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a731a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185742.690346:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789185742.690413:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789185742.690425:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381852516520ns, next at 382852513791ns, rc = 0 00000001:00080000:1.0:1789185742.690432:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1789185742.690454:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f1c33e2500) 00010000:00010000:1.0:1789185742.690457:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789185742.690463:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73191 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e2c expref: 30 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185742.690568:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+29:11156:x1876096879466112:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 29660us (29833us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789185742.690576:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 8 00000020:00080000:1.0:1789185742.690580:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789185742.695100:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185742.695199:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879466368 00000100:00100000:3.0:1789185742.695211:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879466368 00000100:00100000:3.0:1789185742.695286:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 54 00000100:00100000:3.0:1789185742.695306:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+29:11156:x1876096879466368:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185742.695329:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185742.695351:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a731ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.695407:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a731ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e33 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.695423:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a731ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e33 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.695466:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185742.695469:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185742.695473:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db600, rc 0) 00000100:00100000:3.0:1789185742.695537:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+30:11156:x1876096879466368:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 241us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185742.695544:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 54 00000100:00100000:3.0:1789185742.700214:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.701259:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879466624 00000100:00100000:1.0:1789185742.701272:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879466624 00000100:00100000:1.0:1789185742.701337:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:1.0:1789185742.701348:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6597050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+30:11156:x1876096879466624:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:1.0:1789185742.701581:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6597050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+31:11156:x1876096879466624:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 235us (1377us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789185742.701590:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:2.0:1789185742.857292:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185742.857716:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879466880 00000100:00100000:0.0:1789185742.857729:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879466880 00000100:00100000:0.0:1789185742.857972:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00100000:0.0:1789185742.857984:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+31:11167:x1876096879466880:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185742.858007:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185742.858027:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a731b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185742.858155:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789185742.858260:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a731b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e3a expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.858284:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2800) 00010000:00010000:0.0:1789185742.858288:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185742.858294:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a731b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e3a expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185742.858309:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dae00, rc 0) 00000100:00100000:0.0:1789185742.858377:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+32:11167:x1876096879466880:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 395us (1105us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1789185742.858384:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00100000:0.0:1789185742.870817:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185742.870994:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879467008 00000100:00100000:2.0:1789185742.871021:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879467008 00000100:00100000:2.0:1789185742.871082:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00100000:2.0:1789185742.871092:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+32:11167:x1876096879467008:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:2.0:1789185742.871511:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871541:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871554:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871566:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871573:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871579:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871652:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871661:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871668:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185742.871713:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871739:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871746:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871753:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871759:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185742.871763:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871769:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871779:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185742.871782:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185742.871787:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871794:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871806:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871812:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871818:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871827:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185742.871830:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871836:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871842:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f1c33e2700) 00010000:00010000:2.0:1789185742.871845:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185742.871847:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871853:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871861:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871867:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871872:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871878:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185742.871880:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871886:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871901:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185742.871904:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185742.871981:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.871988:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185742.872069:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+32:11167:x1876096879467008:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 976us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185742.872078:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00100000:3.0:1789185742.877575:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.877757:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879467264 00000100:00100000:1.0:1789185742.877782:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879467264 00000100:00100000:1.0:1789185742.877875:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:1.0:1789185742.877885:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+32:11167:x1876096879467264:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:1.0:1789185742.878174:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+33:11167:x1876096879467264:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 290us (608us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789185742.878184:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:0.0:1789185742.922088:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185742.922346:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879467520 00000100:00100000:3.0:1789185742.922357:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879467520 00000100:00100000:2.0:1789185742.922796:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 57 00000100:00100000:2.0:1789185742.922808:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+33:11170:x1876096879467520:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185742.922832:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185742.922852:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.922967:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.922982:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.922993:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923005:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923032:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923039:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923155:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923164:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923171:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185742.923180:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789185742.923258:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923265:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923271:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923277:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185742.923282:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923289:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923310:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185742.923313:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185742.923319:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923325:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a731de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923338:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923344:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923349:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923354:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185742.923356:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923362:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923369:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f1c33e2700) 00010000:00010000:2.0:1789185742.923371:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185742.923374:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923379:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a731e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923432:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a731d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e41 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923446:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e41 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185742.923453:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185742.923455:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185742.923458:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf000, rc 0) 00000100:00100000:2.0:1789185742.923628:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+35:11170:x1876096879467520:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 822us (1549us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789185742.923636:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 57 00000100:00100000:0.0:1789185742.930424:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185742.930729:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879467648 00000100:00100000:3.0:1789185742.930740:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879467648 00000100:00100000:3.0:1789185742.930804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 58 00000100:00100000:3.0:1789185742.930815:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+35:11170:x1876096879467648:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:3.0:1789185742.930881:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.930897:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.931166:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.931216:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.931224:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.931250:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.931256:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185742.931261:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.931267:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.931280:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185742.931283:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185742.931288:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185742.931294:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a731fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185742.931366:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+35:11170:x1876096879467648:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 552us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185742.931375:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 58 00000100:00100000:3.0:1789185742.935016:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185742.944139:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879467904 00000100:00100000:1.0:1789185742.944156:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879467904 00000100:00100000:1.0:1789185742.944246:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00100000:1.0:1789185742.944258:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+35:11170:x1876096879467904:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:1.0:1789185742.944595:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+36:11170:x1876096879467904:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 338us (9586us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789185742.944603:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 11 00010000:00010000:2.0:1789185743.147673:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185743.208081:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185743.208149:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185743.208191:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185743.208228:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185743.208327:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879468288 00000100:00100000:3.0:1789185743.208339:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879468288 00000100:00100000:3.0:1789185743.208415:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879468160 00000100:00100000:3.0:1789185743.208418:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879468160 00000100:00100000:3.0:1789185743.208438:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879468416 00000100:00100000:3.0:1789185743.208441:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879468416 00000100:00100000:3.0:1789185743.208457:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 311 00000100:00100000:3.0:1789185743.208468:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879468288:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185743.208570:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879468288:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 103us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185743.208581:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 311 00000100:00100000:3.0:1789185743.208602:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 312 00000100:00100000:3.0:1789185743.208611:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879468160:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185743.208651:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879468160:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 42us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185743.208658:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 312 00000100:00100000:3.0:1789185743.208670:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 313 00000100:00100000:3.0:1789185743.208676:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879468416:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185743.208697:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879468416:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 22us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185743.208702:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 313 00000100:00080000:0.0:1789185743.208902:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185743.208956:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185743.209123:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879468032 00000100:00100000:2.0:1789185743.209128:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879468032 00000100:00100000:2.0:1789185743.209160:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 386 00000100:00100000:2.0:1789185743.209167:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879468032:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185743.209220:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2390:x1876096879468032:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 53us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185743.209226:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 386 00000100:00100000:0.0:1789185743.271099:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185743.271180:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.271273:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898439040 00000100:00100000:0.0:1789185743.271281:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898439040 00000100:00100000:0.0:1789185743.271343:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789185743.271350:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898439040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185743.271374:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185743.271424:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898439040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185743.271431:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789185743.271479:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185743.272004:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898439168:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272086:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898439680:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272109:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272132:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898440192:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272152:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272169:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898440704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185743.272197:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272214:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789185743.272219:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898439296:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272240:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272256:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898439808:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272272:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272286:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898440320:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272304:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272330:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898439424:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272349:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272372:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898439936:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272390:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272401:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898440448:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272419:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272435:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789185743.272440:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898439552:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272458:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272466:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898440064:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272483:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272493:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898440576:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272507:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185743.272531:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898440192 00000100:00100000:0.0:1789185743.272536:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898440192 00000100:00100000:0.0:1789185743.272574:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898440064 00000100:00100000:0.0:1789185743.272578:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898440064 00000100:00100000:0.0:1789185743.272591:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898440576 00000100:00100000:0.0:1789185743.272593:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898440576 00000100:00100000:0.0:1789185743.272605:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789185743.272612:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898440192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272674:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898440192:12345-0@lo:400:kworker.0 Request processed in 62us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185743.272681:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789185743.272696:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789185743.272702:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898440064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272733:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898440064:12345-0@lo:400:kworker.0 Request processed in 32us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185743.272739:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789185743.272758:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789185743.272764:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898440576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272792:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898440576:12345-0@lo:400:kworker.0 Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185743.272798:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789185743.272827:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898440192:0@lo:400:kworker.0 00000100:00080000:0.0:1789185743.272848:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185743.272852:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185743.272865:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898440064:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272875:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898440576:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.272894:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898439296 00000100:00100000:0.0:1789185743.272897:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898439296 00000100:00100000:0.0:1789185743.272956:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898439808 00000100:00100000:0.0:1789185743.272960:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898439808 00000100:00100000:0.0:1789185743.272980:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898440320 00000100:00100000:0.0:1789185743.272983:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898440320 00000100:00100000:0.0:1789185743.272992:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898439936 00000100:00100000:0.0:1789185743.272994:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898439936 00000100:00100000:0.0:1789185743.273006:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898440448 00000100:00100000:0.0:1789185743.273008:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898440448 00000100:00100000:0.0:1789185743.273018:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898439552 00000100:00100000:0.0:1789185743.273021:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898439552 00000100:00100000:0.0:1789185743.273034:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789185743.273039:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898439296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.273079:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898439296:12345-0@lo:400:kworker.0 Request processed in 39us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185743.273085:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789185743.273097:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789185743.273111:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898439808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.273138:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898439808:12345-0@lo:400:kworker.0 Request processed in 29us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185743.273144:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789185743.273156:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789185743.273162:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898440320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.273186:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898440320:12345-0@lo:400:kworker.0 Request processed in 25us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185743.273192:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789185743.273493:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898439680 00000100:00100000:3.0:1789185743.273498:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898439680 00000100:00100000:3.0:1789185743.273526:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898439424 00000100:00100000:3.0:1789185743.273529:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898439424 00000100:00100000:3.0:1789185743.273550:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789185743.273557:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898439680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.273593:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898439680:12345-0@lo:400:kworker.0 Request processed in 38us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185743.273598:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789185743.273609:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789185743.273614:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898439424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.273668:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898439424:12345-0@lo:400:kworker.0 Request processed in 53us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185743.273674:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789185743.273704:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898439424:0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.273776:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789185743.273786:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898439936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185743.273821:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898439936:12345-0@lo:400:kworker.0 Request processed in 38us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185743.274138:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898440704 00000100:00100000:1.0:1789185743.274143:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898440704 00000100:00100000:1.0:1789185743.274176:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789185743.274184:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898440704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185743.274198:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185743.274238:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898440704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185743.274243:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789185743.274266:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898440832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185743.274296:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185743.274330:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898440832 00000100:00100000:1.0:1789185743.274334:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898440832 00000100:00100000:1.0:1789185743.274351:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789185743.274366:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898440832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185743.274389:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1789185743.274425:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898440832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185743.274431:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789185743.274463:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898440832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185743.274563:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898439168 00000100:00100000:2.0:1789185743.274568:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898439168 00000100:00100000:2.0:1789185743.274600:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789185743.274607:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898439168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185743.274643:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898439168:12345-0@lo:400:kworker.0 Request processed in 38us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185743.274656:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789185743.275747:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789185743.275766:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898440448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.275820:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898440448:12345-0@lo:400:kworker.0 Request processed in 63us (3400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185743.275825:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789185743.275849:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789185743.275856:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898439552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.275877:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898439552:12345-0@lo:400:kworker.0 Request processed in 23us (3419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185743.275882:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789185743.275933:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898439552:0@lo:400:kworker.0 00010000:00080000:3.0:1789185743.275961:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff9fb480 x1876096898439936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185743.275971:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898439936:0@lo:400:kworker.0 00010000:00080000:3.0:1789185743.275982:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2ff9f8380 x1876096898440448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185743.275989:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898440448:0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.276044:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898439296:0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.276074:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898439808:0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.276085:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898440320:0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.276096:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898439168:0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.276107:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898439680:0@lo:400:kworker.0 00000100:00100000:3.0:1789185743.276125:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898440704:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789185743.276154:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185743.276158:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185743.276336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789185743.370749:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185743.370842:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879468672 00000100:00100000:3.0:1789185743.370853:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879468672 00000100:00100000:3.0:1789185743.370974:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:3.0:1789185743.370986:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+36:11201:x1876096879468672:12345-192.168.204.48@tcp:101:cat.0 00010000:00010000:3.0:1789185743.371012:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185743.371033:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73201 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e48 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.371146:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73208 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.371162:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.371174:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73208 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185743.371185:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789185743.371316:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73201 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e48 expref: 39 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.371356:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73208 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e48 expref: 38 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.371365:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185743.371368:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185743.371372:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185743.371444:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+38:11201:x1876096879468672:12345-192.168.204.48@tcp:101:cat.0 Request processed in 459us (704us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789185743.371451:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:0.0:1789185743.377009:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185743.377103:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879468928 00000100:00100000:1.0:1789185743.377114:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879468928 00000100:00100000:1.0:1789185743.377179:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:1.0:1789185743.377191:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+38:11201:x1876096879468928:12345-192.168.204.48@tcp:35:cat.0 00000100:00100000:1.0:1789185743.377445:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+39:11201:x1876096879468928:12345-192.168.204.48@tcp:35:cat.0 Request processed in 255us (445us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789185743.377452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:0.0:1789185743.379872:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185743.380163:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879469056 00000100:00100000:2.0:1789185743.380173:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879469056 00000100:00100000:2.0:1789185743.380243:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:2.0:1789185743.380254:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+39:2389:x1876096879469056:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185743.380271:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185743.380298:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73208 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e48 expref: 39 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185743.380319:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185743.380324:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185743.380381:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+38:2389:x1876096879469056:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 129us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185743.380389:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:0.0:1789185743.487562:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185743.487670:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879469312 00000100:00100000:3.0:1789185743.487681:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879469312 00000100:00100000:3.0:1789185743.487764:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:3.0:1789185743.487774:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+38:11207:x1876096879469312:12345-192.168.204.48@tcp:101:dd.0 00010000:00010000:3.0:1789185743.487798:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185743.487801:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789185743.487828:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7316e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e1e expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.487847:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:3.0:1789185743.487852:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185743.487865:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73216 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e4f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.488048:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.488082:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e41 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.488091:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.488121:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e41 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.488135:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e41 expref: 38 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185743.488148:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898440960:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185743.488237:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185743.492998:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898440960:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185743.493044:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185743.494416:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185743.494525:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879469440 00000100:00100000:1.0:1789185743.494534:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879469440 00010000:00010000:1.0:1789185743.494579:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e41 expref: 39 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185743.494623:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00100000:1.0:1789185743.494633:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+39:2392:x1876096879469440:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185743.494648:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185743.494655:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e41 expref: 39 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.494666:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e41 expref: 39 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.494710:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a731ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e41 expref: 39 pid: 6514 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.494726:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185743.494731:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.494751:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.494759:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.494789:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185743.494846:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+38:2392:x1876096879469440:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 214us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185743.494854:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 55 00010000:00010000:3.0:1789185743.496431:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.496447:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185743.496469:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789185743.496684:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73216 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e4f expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.496732:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e4f expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.496751:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185743.496754:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185743.496757:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db400, rc 0) 00000100:00100000:3.0:1789185743.496837:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+38:11207:x1876096879469312:12345-192.168.204.48@tcp:101:dd.0 Request processed in 9063us (9284us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789185743.496847:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:0.0:1789185743.505746:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185743.505896:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879469568 00000100:00100000:2.0:1789185743.505927:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879469568 00000100:00100000:2.0:1789185743.506011:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:2.0:1789185743.506022:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+38:11207:x1876096879469568:12345-192.168.204.48@tcp:101:dd.0 00010000:00010000:2.0:1789185743.506048:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185743.506069:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7322b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e56 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185743.506105:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185743.506121:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185743.506155:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185743.506274:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7322b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e56 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185743.506292:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e56 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185743.506302:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185743.506305:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789185743.506309:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf600, rc 0) 00000100:00100000:2.0:1789185743.506376:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+39:11207:x1876096879469568:12345-192.168.204.48@tcp:101:dd.0 Request processed in 355us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185743.506383:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:0.0:1789185743.510891:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185743.512389:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879469824 00000100:00100000:1.0:1789185743.512403:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879469824 00000100:00100000:1.0:1789185743.512577:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 62 00000100:00100000:1.0:1789185743.512588:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+39:11207:x1876096879469824:12345-192.168.204.48@tcp:36:dd.0 00010000:00010000:1.0:1789185743.512860:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.512878:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.512889:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185743.513391:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1789185743.513420:0:6513:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009ae6a792 reply state 0000000092de7dde transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.513435:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185743.513444:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185743.513447:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789185743.513451:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185743.513694:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+42:11207:x1876096879469824:12345-192.168.204.48@tcp:36:dd.0 Request processed in 1105us (2812us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1789185743.513702:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 62 00000020:00080000:1.0:1789185743.513707:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789185743.998740:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185743.998849:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879469952 00000100:00100000:3.0:1789185743.998864:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879469952 00000100:00100000:3.0:1789185743.999267:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 63 00000100:00100000:3.0:1789185743.999280:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+42:11221:x1876096879469952:12345-192.168.204.48@tcp:101:stat.0 00010000:00010000:3.0:1789185743.999304:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185743.999327:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73240 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e5d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999393:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999408:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999421:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999433:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999455:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999462:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999545:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999556:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e4f expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999564:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999598:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e4f expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185743.999626:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e4f expref: 43 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185743.999639:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898441088:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185743.999753:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185744.007121:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185744.007319:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898441088:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185744.007348:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185744.007372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879470208 00000100:00100000:1.0:1789185744.007381:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879470208 00000100:00100000:1.0:1789185744.007462:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:1.0:1789185744.007474:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+44:6161:x1876096879470208:12345-192.168.204.48@tcp:35:ldlm_bl.0 00000100:00080000:3.0:1789185744.007499:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185744.007792:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+45:6161:x1876096879470208:12345-192.168.204.48@tcp:35:ldlm_bl.0 Request processed in 319us (681us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789185744.007799:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:0.0:1789185744.020502:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185744.020691:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879470336 00000100:00100000:2.0:1789185744.020704:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879470336 00010000:00010000:2.0:1789185744.020758:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e4f expref: 45 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185744.020811:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00100000:2.0:1789185744.020825:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+45:2390:x1876096879470336:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185744.020845:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185744.021167:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e4f expref: 45 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.021183:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e4f expref: 45 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.021237:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7321d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e4f expref: 45 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.021256:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185744.021262:0:10394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.021275:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.021284:0:10394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.021324:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185744.021441:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+44:2390:x1876096879470336:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 618us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185744.021450:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 56 00010000:00010000:3.0:1789185744.021651:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021663:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185744.021742:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789185744.021747:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789185744.021798:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021815:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021836:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021843:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021851:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021858:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185744.021863:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021872:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021883:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:3.0:1789185744.021886:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185744.021891:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021960:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73247 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021974:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021980:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021986:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.021991:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185744.021994:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.022000:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.022009:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f1c33e2700) 00010000:00010000:3.0:1789185744.022012:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185744.022014:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.022020:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7324e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.022063:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73240 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e5d expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.022079:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e5d expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.022093:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185744.022096:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185744.022098:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185744.022132:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+43:11221:x1876096879469952:12345-192.168.204.48@tcp:101:stat.0 Request processed in 22856us (23406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185744.022139:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 63 00000100:00100000:0.0:1789185744.158204:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185744.158429:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879470592 00000100:00100000:3.0:1789185744.158455:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879470592 00000100:00100000:3.0:1789185744.158561:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 64 00000100:00100000:3.0:1789185744.158576:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+43:11227:x1876096879470592:12345-192.168.204.48@tcp:36:truncate.0 00010000:00010000:3.0:1789185744.158868:0:8147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185744.158973:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73255 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e5d expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.159004:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185744.159012:0:8147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185744.159281:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.159300:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.159391:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185744.159664:0:8147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1789185744.159697:0:8147:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004234a7b6 reply state 00000000a82905c1 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.159729:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.159736:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185744.159738:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185744.159742:0:8147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185744.159896:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+45:11227:x1876096879470592:12345-192.168.204.48@tcp:36:truncate.0 Request processed in 1321us (1710us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789185744.160025:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 64 00000020:00080000:3.0:1789185744.160034:0:8147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789185744.166228:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185744.350058:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185744.350284:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879470720 00000100:00100000:1.0:1789185744.350302:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879470720 00000100:00100000:1.0:1789185744.350385:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00100000:1.0:1789185744.350397:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+45:11241:x1876096879470720:12345-192.168.204.48@tcp:101:stat.0 00010000:00010000:1.0:1789185744.350423:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185744.350460:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73263 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e64 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.350536:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.350633:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.350646:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.350660:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.350668:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.350675:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.351541:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.351629:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.351640:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185744.351708:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789185744.351714:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185744.352018:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.352045:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.352057:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.352719:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353295:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353301:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185744.353306:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353315:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353334:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185744.353338:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185744.353345:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353352:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7326a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353377:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353385:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353411:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353417:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185744.353420:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353426:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353435:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f1c33e2700) 00010000:00010000:1.0:1789185744.353438:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185744.353441:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353446:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73271 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353496:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a73263 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e64 expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353515:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e64 expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.353523:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185744.353526:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185744.353528:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9a00, rc 0) 00000100:00100000:1.0:1789185744.357471:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+46:11241:x1876096879470720:12345-192.168.204.48@tcp:101:stat.0 Request processed in 7062us (7416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185744.357504:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00100000:0.0:1789185744.480627:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185744.480810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879470976 00000100:00100000:3.0:1789185744.480824:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879470976 00000100:00100000:3.0:1789185744.481014:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 66 00000100:00100000:3.0:1789185744.481030:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+46:11251:x1876096879470976:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185744.481061:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185744.481089:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7327f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e6b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185744.481243:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789185744.481384:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7327f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e6b expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.481401:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2800) 00010000:00010000:3.0:1789185744.481404:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185744.481411:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7327f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e6b expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.481454:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185744.481561:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+47:11251:x1876096879470976:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 534us (949us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1789185744.481570:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 66 00000100:00100000:2.0:1789185744.488882:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185744.489759:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879471232 00000100:00100000:0.0:1789185744.489776:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879471232 00000100:00100000:0.0:1789185744.489893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:0.0:1789185744.489949:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+47:11251:x1876096879471232:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:0.0:1789185744.490516:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+48:11251:x1876096879471232:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 599us (1638us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789185744.490527:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:3.0:1789185744.569094:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185744.569460:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879471488 00000100:00100000:0.0:1789185744.569476:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879471488 00000100:00100000:0.0:1789185744.570191:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:0.0:1789185744.570207:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+48:11257:x1876096879471488:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185744.570243:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185744.570283:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a7328d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e72 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.571344:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.571376:0:8147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e64 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.571389:0:8147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.571456:0:8147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e64 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.571684:0:8147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e64 expref: 49 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185744.571707:0:8147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ffa81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8147:1876096898441216:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185744.571892:0:8147:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789185744.578824:0:8147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ffa81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8147:1876096898441216:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185744.578887:0:8147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185744.580206:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185744.580333:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879471616 00000100:00100000:1.0:1789185744.580348:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879471616 00010000:00010000:1.0:1789185744.580420:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e64 expref: 50 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185744.580482:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 57 00000100:00100000:1.0:1789185744.580495:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+50:2392:x1876096879471616:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185744.580565:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185744.580577:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e64 expref: 50 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.580594:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e64 expref: 50 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.580629:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a73278 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e64 expref: 50 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.580658:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185744.580666:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.580681:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.580694:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.580748:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185744.580822:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+49:2392:x1876096879471616:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 330us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185744.580831:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 57 00010000:00010000:0.0:1789185744.581546:0:8147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.581559:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185744.581595:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789185744.581809:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a7328d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e72 expref: 50 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.581835:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e72 expref: 49 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.581844:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:0.0:1789185744.581847:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789185744.581851:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db800, rc 0) 00000100:00100000:0.0:1789185744.581902:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+49:11257:x1876096879471488:12345-192.168.204.48@tcp:101:bash.0 Request processed in 11699us (12823us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789185744.582231:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:3.0:1789185744.589426:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185744.590317:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879471872 00000100:00100000:1.0:1789185744.590348:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879471872 00000100:00100000:1.0:1789185744.590443:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00100000:1.0:1789185744.590460:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+49:11257:x1876096879471872:12345-192.168.204.48@tcp:36:bash.0 00010000:00010000:1.0:1789185744.590872:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.590903:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.591709:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185744.591803:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1789185744.591843:0:6513:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000079141f1f reply state 0000000056977dc5 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.591860:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.591870:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185744.591874:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789185744.591879:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185744.592905:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+52:11257:x1876096879471872:12345-192.168.204.48@tcp:36:bash.0 Request processed in 2435us (3484us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789185744.593070:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 68 00000020:00080000:1.0:1789185744.593080:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789185744.610759:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185744.612115:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879472000 00000100:00100000:0.0:1789185744.612134:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879472000 00000100:00100000:0.0:1789185744.612349:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:0.0:1789185744.612366:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+52:11257:x1876096879472000:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185744.612410:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185744.612443:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a732a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e79 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.613422:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.613460:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e72 expref: 53 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.613474:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.613532:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e72 expref: 53 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.613555:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e72 expref: 53 pid: 8147 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185744.614450:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ffa81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898441344:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185744.615886:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185744.634461:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ffa81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898441344:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185744.634525:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185744.635857:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185744.636129:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879472128 00000100:00100000:3.0:1789185744.636143:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879472128 00010000:00010000:2.0:1789185744.636273:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e72 expref: 54 pid: 8147 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185744.636382:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 58 00000100:00100000:2.0:1789185744.636396:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+54:2392:x1876096879472128:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185744.636424:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185744.636433:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e72 expref: 54 pid: 8147 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.636463:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e72 expref: 54 pid: 8147 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.636496:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73294 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e72 expref: 54 pid: 8147 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.636531:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185744.636538:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.636552:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.636563:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.636652:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185744.636738:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+53:2392:x1876096879472128:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 345us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185744.636746:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 58 00010000:00010000:1.0:1789185744.639497:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.640256:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185744.640467:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789185744.640473:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185744.640646:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.640722:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a732a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e79 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.640754:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e79 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.640765:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185744.640769:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185744.640775:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db600, rc 0) 00000100:00100000:1.0:1789185744.641988:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+52:11257:x1876096879472000:12345-192.168.204.48@tcp:101:bash.0 Request processed in 29614us (31236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185744.642004:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:0.0:1789185744.662873:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185744.664978:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879472384 00000100:00100000:3.0:1789185744.665002:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879472384 00000100:00100000:3.0:1789185744.665110:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:3.0:1789185744.665124:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6597450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+52:11257:x1876096879472384:12345-192.168.204.48@tcp:35:bash.0 00000100:00100000:3.0:1789185744.665520:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6597450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+53:11257:x1876096879472384:12345-192.168.204.48@tcp:35:bash.0 Request processed in 396us (2662us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789185744.665528:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:0.0:1789185744.774433:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185744.779529:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879472640 00000100:00100000:3.0:1789185744.779556:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879472640 00000100:00100000:3.0:1789185744.779686:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 70 00000100:00100000:3.0:1789185744.779699:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+53:11267:x1876096879472640:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185744.779737:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185744.779795:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a732b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e80 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185744.780031:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789185744.780194:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a732b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e80 expref: 55 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.780218:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2800) 00010000:00010000:3.0:1789185744.780222:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185744.780229:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a732b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e80 expref: 55 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.780248:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dac00, rc 0) 00000100:00100000:3.0:1789185744.780346:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+54:11267:x1876096879472640:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 649us (5931us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1789185744.780355:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 70 00000100:00100000:2.0:1789185744.789143:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185744.793355:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879472768 00000100:00100000:1.0:1789185744.793384:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879472768 00000100:00100000:1.0:1789185744.793494:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 71 00000100:00100000:1.0:1789185744.793508:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+54:11267:x1876096879472768:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:1.0:1789185744.793661:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.793684:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.793698:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.793712:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.793720:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.793726:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.793836:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.793846:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.793854:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185744.793978:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.793995:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794015:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794022:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794029:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185744.794035:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794045:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794061:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185744.794065:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185744.794072:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794079:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794098:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794105:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794111:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794116:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185744.794126:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794133:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794142:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f1c33e2700) 00010000:00010000:1.0:1789185744.794144:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185744.794148:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794154:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794166:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794172:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794190:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794195:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185744.794199:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794205:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794213:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185744.794216:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185744.794227:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.794233:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a732d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185744.794356:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+54:11267:x1876096879472768:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 849us (5230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185744.794364:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 71 00000100:00100000:0.0:1789185744.802479:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185744.802986:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879473024 00000100:00100000:3.0:1789185744.803005:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879473024 00000100:00100000:3.0:1789185744.803084:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00100000:3.0:1789185744.803099:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+54:11267:x1876096879473024:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185744.803514:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+55:11267:x1876096879473024:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 416us (1048us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789185744.803524:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00100000:3.0:1789185744.807991:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898441472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185744.808122:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185744.808978:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898441472 00000100:00100000:1.0:1789185744.808995:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898441472 00000100:00100000:1.0:1789185744.809072:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789185744.809085:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898441472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185744.809146:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185744.809251:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898441472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185744.809259:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789185744.812086:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898441472:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1789185744.813268:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:2.0:1789185744.813354:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789185744.813486:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813530:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813539:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813547:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddec00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185744.813553:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813564:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813595:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98f2fae07000) 00010000:00010000:3.0:1789185744.813599:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185744.813605:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813612:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a730e9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813643:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813650:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813656:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813662:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185744.813674:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813681:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813691:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:3.0:1789185744.813694:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185744.813697:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813705:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a730f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813723:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813730:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813735:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813740:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a2000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185744.813743:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813748:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813755:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f1c33e2700) 00010000:00010000:3.0:1789185744.813758:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185744.813769:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813774:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a7312f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813796:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813802:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813808:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813814:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185744.813817:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813822:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813831:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185744.813833:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185744.813837:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813842:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73239 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813856:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813862:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813896:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813902:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185744.813904:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813982:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.813991:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185744.813994:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185744.813997:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.814003:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7325c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.814017:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.814023:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.814029:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.814035:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9a00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185744.814037:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.814054:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.814063:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185744.814066:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185744.814068:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.814073:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a732a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185744.814818:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898441600:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789185744.814955:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185744.815207:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898441600 00000100:00100000:0.0:1789185744.815219:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898441600 00000100:00100000:0.0:1789185744.815321:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789185744.815337:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898441600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789185744.815376:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1789185744.815428:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa4cece, atime: 0x6aa4cece, ctime: 0x6aa4cece, blocks: 0x8 00010000:00010000:0.0:1789185744.815438:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.815461:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1789185744.815467:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185744.815476:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.815496:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.815508:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.815517:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.815544:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789185744.815831:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898441600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 498us (875us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789185744.815841:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789185744.815876:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185744.815883:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.815893:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185744.815898:0:9518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789185744.816117:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789185744.816182:0:9518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.816205:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.816213:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a65e243/0xda5c730d5a732da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185744.816245:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185744.816247:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185744.816249:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789185744.816307:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f2ffa82300/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789185744.816315:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ffa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898441600:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1789185744.817185:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f2c4fc1e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789185744.817200:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f2e7a8f900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f2c4fc1cc0 00000020:00080000:2.0:1789185744.817204:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f1c3716100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f2d65e5c00 00000020:00080000:3.0:1789185744.817283:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789185744.817611:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789185744.869964:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185744.870114:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879473280 00000100:00100000:1.0:1789185744.870133:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879473280 00000100:00100000:1.0:1789185744.870225:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 72 00000100:00100000:1.0:1789185744.870239:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+12:11270:x1876096879473280:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185744.870277:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185744.870321:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e87 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870442:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870483:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870503:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870524:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870531:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870538:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870729:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a732f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870742:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a732f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870750:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a732f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185744.870762:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789185744.870887:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870897:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870905:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870973:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185744.870979:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.870988:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871004:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185744.871008:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185744.871019:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871027:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a732e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871045:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871051:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871058:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871062:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185744.871065:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871071:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871091:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f300ff1200) 00010000:00010000:1.0:1789185744.871093:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185744.871096:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871103:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a732ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871162:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a732e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e87 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871182:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a732f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e87 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185744.871189:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185744.871191:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185744.871194:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8000, rc 0) 00000100:00100000:1.0:1789185744.871292:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11270:x1876096879473280:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1056us (1391us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789185744.871301:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 72 00000100:00100000:1.0:1789185744.883161:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185744.886701:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879473408 00000100:00100000:3.0:1789185744.886725:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879473408 00000100:00100000:3.0:1789185744.886822:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 73 00000100:00100000:3.0:1789185744.886835:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11270:x1876096879473408:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:3.0:1789185744.886970:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.886995:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.887011:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.887064:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.887100:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.887109:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.887116:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185744.887122:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.887132:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.887149:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185744.887154:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185744.887161:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185744.887185:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73304 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185744.892022:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11270:x1876096879473408:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 5166us (8855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185744.892043:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 73 00000100:00100000:0.0:1789185744.895380:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185744.895649:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879473536 00000100:00100000:2.0:1789185744.895667:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879473536 00000100:00100000:2.0:1789185744.895766:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:2.0:1789185744.895779:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+14:2392:x1876096879473536:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185744.895801:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185744.895834:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a732f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e87 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185744.895863:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185744.895870:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185744.895990:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+13:2392:x1876096879473536:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 213us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185744.896000:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:1.0:1789185744.899794:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185744.900335:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879473792 00000100:00100000:3.0:1789185744.900349:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879473792 00000100:00100000:3.0:1789185744.900416:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:3.0:1789185744.900427:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+13:11270:x1876096879473792:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185744.900712:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11270:x1876096879473792:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 286us (934us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789185744.900736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:1.0:1789185745.151998:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.153803:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879474048 00000100:00100000:2.0:1789185745.153827:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879474048 00000100:00100000:2.0:1789185745.153974:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 74 00000100:00100000:2.0:1789185745.153988:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11288:x1876096879474048:12345-192.168.204.48@tcp:101:cat.0 00010000:00010000:2.0:1789185745.154025:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185745.154056:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7330b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e8e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.154220:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73312 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.154240:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73312 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.154257:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73312 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185745.154296:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789185745.154455:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7330b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e8e expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.154480:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73312 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e8e expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.154492:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185745.154495:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789185745.154501:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde600, rc 0) 00000100:00100000:2.0:1789185745.154632:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11288:x1876096879474048:12345-192.168.204.48@tcp:101:cat.0 Request processed in 644us (2648us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789185745.154640:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 74 00010000:00010000:3.0:1789185745.190250:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185745.247807:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.247960:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879474176 00000100:00100000:2.0:1789185745.247976:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879474176 00000100:00100000:2.0:1789185745.248070:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 75 00000100:00100000:2.0:1789185745.248082:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11289:x1876096879474176:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185745.248132:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185745.248167:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e95 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.248277:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a73327 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.248296:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a73327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.248337:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a73327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185745.248404:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789185745.248410:0:9473:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185745.248435:0:9473:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a73327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.248470:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a73320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e95 expref: 18 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.248493:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a73327 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e95 expref: 17 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.248504:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185745.248507:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185745.248511:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddfc00, rc 0) 00000100:00100000:2.0:1789185745.248602:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11289:x1876096879474176:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 522us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185745.248610:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 75 00000100:00100000:3.0:1789185745.263799:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.264069:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879474560 00000100:00100000:2.0:1789185745.264084:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879474560 00000100:00100000:2.0:1789185745.264169:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:2.0:1789185745.264184:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11289:x1876096879474560:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:2.0:1789185745.264855:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11289:x1876096879474560:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 670us (1070us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789185745.264867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:3.0:1789185745.281697:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185745.282724:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879474688 00000100:00100000:0.0:1789185745.282745:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879474688 00000100:00100000:0.0:1789185745.282855:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:0.0:1789185745.282868:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11289:x1876096879474688:12345-192.168.204.48@tcp:103:lfs.0 00010000:00010000:0.0:1789185745.282967:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789185745.283006:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a732b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e79 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.283036:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73312 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e8e expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.283053:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a731ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e33 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.283067:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:0.0:1789185745.283073:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185745.283161:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+15:11289:x1876096879474688:12345-192.168.204.48@tcp:103:lfs.0 Request processed in 295us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185745.283170:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:1.0:1789185745.285807:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.285903:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879474816 00000100:00100000:2.0:1789185745.285965:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879474816 00000100:00100000:2.0:1789185745.286046:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 76 00000100:00100000:2.0:1789185745.286058:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+15:11289:x1876096879474816:12345-192.168.204.48@tcp:58:lfs.0 00010000:00010000:2.0:1789185745.286222:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.286650:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.286667:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185745.288742:0:8147:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185745.290755:0:8147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789185745.293111:0:8147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789185745.294160:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+15:11289:x1876096879474816:12345-192.168.204.48@tcp:58:lfs.0 Request processed in 8091us (8356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185745.294180:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 76 00000100:00100000:3.0:1789185745.364100:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185745.364298:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879474944 00000100:00100000:0.0:1789185745.364314:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879474944 00000100:00100000:0.0:1789185745.364406:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 77 00000100:00100000:0.0:1789185745.364420:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+15:11291:x1876096879474944:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185745.364448:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185745.364478:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73335 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51e9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364602:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364621:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364636:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364654:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364662:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364669:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364773:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364784:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364792:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185745.364852:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789185745.364857:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185745.364885:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364981:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.364992:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365000:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365008:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365014:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dae00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185745.365019:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365028:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365044:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:0.0:1789185745.365048:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185745.365053:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365060:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7333c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365079:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365086:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365105:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365110:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dbc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185745.365112:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365119:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365127:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f1c33e2300) 00010000:00010000:0.0:1789185745.365130:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185745.365133:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365139:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73343 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365180:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73335 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e9c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365196:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e9c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.365205:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:0.0:1789185745.365208:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185745.365211:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db800, rc 0) 00000100:00100000:0.0:1789185745.365292:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11291:x1876096879474944:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 875us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185745.365310:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 77 00000040:00080000:2.0:1789185745.704486:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185745.704500:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185745.704575:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789185745.704589:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185745.704806:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898441728:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185745.705006:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1789185745.715694:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898441728:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789185745.717954:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185745.718106:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879475072 00000100:00100000:3.0:1789185745.718122:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879475072 00000100:00100000:3.0:1789185745.718203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 78 00000100:00100000:3.0:1789185745.718216:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11302:x1876096879475072:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789185745.718274:0:6513:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185745.718497:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11302:x1876096879475072:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 282us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185745.718506:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 78 00000100:00100000:1.0:1789185745.737366:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.737462:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879475200 00000100:00100000:2.0:1789185745.737477:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879475200 00000100:00100000:2.0:1789185745.737564:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 79 00000100:00100000:2.0:1789185745.737585:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11302:x1876096879475200:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789185745.737704:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.737728:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.737743:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741410:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741437:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741453:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741501:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741511:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741517:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185745.741573:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789185745.741578:0:8147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185745.741594:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741828:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741835:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741843:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741849:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185745.741854:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741862:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741877:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:2.0:1789185745.741881:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185745.741887:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741892:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73351 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741975:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741981:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741987:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.741999:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddec00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185745.742003:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742009:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742019:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff98f2d2ed4700) 00010000:00010000:2.0:1789185745.742022:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185745.742024:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742030:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73358 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742048:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742055:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742061:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742068:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185745.742071:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742078:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742101:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185745.742104:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185745.742108:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.742114:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7335f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185745.742300:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11302:x1876096879475200:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 Request processed in 4714us (4948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185745.742312:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 79 00000100:00100000:1.0:1789185745.756099:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.756210:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879475456 00000100:00100000:2.0:1789185745.756226:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879475456 00000100:00100000:2.0:1789185745.756317:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 80 00000100:00100000:2.0:1789185745.756330:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11302:x1876096879475456:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185745.756353:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185745.756375:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73366 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ea3 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756493:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756507:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756520:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185745.756532:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789185745.756646:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756654:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756660:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756665:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddec00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185745.756670:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756689:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756701:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:2.0:1789185745.756704:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185745.756710:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756716:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a7336d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756757:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73366 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ea3 expref: 18 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756767:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:2.0:1789185745.756769:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185745.756773:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a73366 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ea3 expref: 18 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.756791:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde600, rc 0) 00000100:00100000:2.0:1789185745.756861:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11302:x1876096879475456:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 533us (775us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789185745.756869:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 80 00000100:00100000:1.0:1789185745.769523:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185745.770234:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879475584 00000100:00100000:3.0:1789185745.770254:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879475584 00000100:00100000:3.0:1789185745.770481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 81 00000100:00100000:3.0:1789185745.770497:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11302:x1876096879475584:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789185745.770616:0:6513:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185745.770801:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11302:x1876096879475584:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 308us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185745.770810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 81 00000100:00100000:1.0:1789185745.778163:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.778309:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879475840 00000100:00100000:2.0:1789185745.778324:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879475840 00000100:00100000:2.0:1789185745.778406:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 82 00000100:00100000:2.0:1789185745.778418:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11302:x1876096879475840:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185745.778449:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185745.778453:0:8147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789185745.778521:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a73327 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e95 expref: 17 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.778543:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185745.778549:0:8147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185745.778567:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7337b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51eaa expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185745.779677:0:8147:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789185745.779883:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.781119:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.781145:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.781285:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7337b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eaa expref: 19 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.781607:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eaa expref: 18 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.781617:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f2d2ed4700) 00010000:00010000:2.0:1789185745.781620:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185745.781625:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddec00, rc 0) 00000100:00100000:2.0:1789185745.781730:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11302:x1876096879475840:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 3312us (3583us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789185745.781740:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 82 00000100:00100000:1.0:1789185745.787314:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.787470:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879476096 00000100:00100000:2.0:1789185745.787484:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879476096 00000100:00100000:2.0:1789185745.787572:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 83 00000100:00100000:2.0:1789185745.787584:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11302:x1876096879476096:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185745.787666:0:9473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185745.787705:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a73382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eaa expref: 18 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787726:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f2d2ed4700) 00010000:00010000:2.0:1789185745.787739:0:9473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185745.787768:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787785:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787808:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787846:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787853:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787859:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787966:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787976:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787983:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.787990:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185745.787997:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788006:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788015:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185745.788018:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185745.788023:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788036:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a73390 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788046:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788051:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788056:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788061:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185745.788064:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788071:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788079:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x979a1cf7 (ffff98f2d2ed4100) 00010000:00010000:2.0:1789185745.788081:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185745.788084:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.788090:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73397 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x979a1cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185745.788205:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11302:x1876096879476096:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 622us (915us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185745.788214:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 83 00000100:00100000:1.0:1789185745.797519:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185745.797634:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879476224 00000100:00100000:0.0:1789185745.797651:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879476224 00000100:00100000:0.0:1789185745.797736:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 84 00000100:00100000:0.0:1789185745.797748:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11302:x1876096879476224:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185745.797778:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185745.797809:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7339e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51eb1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.797855:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.797873:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.797887:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.798083:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a7339e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb1 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.798107:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb1 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.798118:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:0.0:1789185745.798121:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789185745.798126:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021da800, rc 0) 00000100:00100000:0.0:1789185745.798205:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11302:x1876096879476224:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 459us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185745.798220:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 84 00000100:00100000:0.0:1789185745.809693:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.811226:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879476480 00000100:00100000:2.0:1789185745.811246:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879476480 00000100:00100000:2.0:1789185745.811363:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 85 00000100:00100000:2.0:1789185745.811378:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11302:x1876096879476480:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185745.811519:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.811545:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.811560:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185745.811809:0:8147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1789185745.811822:0:8147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384973912939ns, next at 385973909511ns, rc = 0 00000004:00010000:2.0:1789185745.811887:0:8147:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005e620508 reply state 000000004ae6483f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.811948:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.811957:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:2.0:1789185745.811960:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789185745.811966:0:8147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185745.812118:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+20:11302:x1876096879476480:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 743us (2440us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789185745.812127:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 85 00000100:00100000:0.0:1789185745.816327:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185745.816428:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879476608 00000100:00100000:1.0:1789185745.816443:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879476608 00000100:00100000:1.0:1789185745.816519:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 86 00000100:00100000:1.0:1789185745.816531:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+20:11302:x1876096879476608:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185745.816574:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185745.816602:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51eb8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.816690:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb8 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.816711:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb8 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.816738:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:1.0:1789185745.816742:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185745.816747:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9a00, rc 0) 00000100:00100000:1.0:1789185745.816847:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:11302:x1876096879476608:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 307us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185745.816856:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 86 00000100:00100000:0.0:1789185745.824277:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.824369:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879476736 00000100:00100000:2.0:1789185745.824386:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879476736 00000100:00100000:2.0:1789185745.824450:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:2.0:1789185745.824461:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876096879476736:12345-192.168.204.48@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789185745.824545:0:9819:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:2.0:1789185745.824591:0:9819:0:(genops.c:1384:class_connect()) connect: client f993ea83-7802-4340-a17e-bffdbb8158b1, cookie 0xda5c730d5a733ba 00002000:00100000:2.0:1789185745.824610:0:9819:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f993ea83-7802-4340-a17e-bffdbb8158b1/ffff98f1c37b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789185745.824641:0:9819:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789185745.824759:0:9819:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789185745.824805:0:9819:0:(import.c:65:import_set_state_nolock()) ffff98f2d8be7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185745.824960:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2388:x1876096879476736:12345-192.168.204.48@tcp:8:lhsmtool_posix.0 Request processed in 498us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185745.824969:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:2.0:1789185745.829848:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185745.830093:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185745.830119:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898441856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185745.830187:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185745.830264:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898441856 00000100:00100000:3.0:1789185745.830296:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898441856 00000100:00100000:3.0:1789185745.830371:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789185745.830382:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898441856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185745.830426:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185745.830480:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898441856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185745.830488:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789185745.830525:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185745.830570:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898441856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185745.834234:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898441984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185745.834433:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185745.834713:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898441984 00000100:00100000:2.0:1789185745.834725:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898441984 00000100:00100000:2.0:1789185745.834814:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789185745.834826:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f30119ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898441984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185745.834866:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185745.835393:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f30119ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898441984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 567us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185745.835402:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1789185745.835866:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185745.835954:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898441984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185745.836074:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879476864 00000100:00100000:0.0:1789185745.836082:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879476864 00000100:00100000:0.0:1789185745.836148:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 34 00000100:00100000:0.0:1789185745.836157:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:0:x1876096879476864:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789185745.836374:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789185745.854782:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1789185745.854801:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000100:00100000:0.0:1789185745.855121:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:0:x1876096879476864:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 18949us (25278us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789185745.855137:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 34 00000100:00100000:2.0:1789185745.860988:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185745.861269:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879477120 00000100:00100000:1.0:1789185745.861284:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879477120 00000100:00100000:1.0:1789185745.861375:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:1.0:1789185745.861412:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+21:11302:x1876096879477120:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789185745.861767:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11302:x1876096879477120:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 358us (795us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789185745.861776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:2.0:1789185745.867659:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185745.867792:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879477376 00000100:00100000:1.0:1789185745.867806:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879477376 00000100:00100000:1.0:1789185745.867889:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 87 00000100:00100000:1.0:1789185745.867947:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11302:x1876096879477376:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789185745.868108:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11302:x1876096879477376:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 197us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185745.868117:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 87 00000100:00100000:3.0:1789185745.877325:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.877785:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879477504 00000100:00100000:2.0:1789185745.877804:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879477504 00000100:00100000:2.0:1789185745.877887:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 88 00000100:00100000:2.0:1789185745.877934:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11302:x1876096879477504:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185745.877963:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185745.877997:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a733c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ebf expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.878113:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a733c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.878132:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a733c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.878148:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a733c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185745.878206:0:8147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185745.878232:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a733c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.878265:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a733c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ebf expref: 24 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.878283:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a733c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ebf expref: 23 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.878304:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:2.0:1789185745.878321:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789185745.878326:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e400, rc 0) 00000100:00100000:2.0:1789185745.878413:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+23:11302:x1876096879477504:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 505us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185745.878422:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 88 00000100:00100000:0.0:1789185745.883284:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185745.883419:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879477632 00000100:00100000:1.0:1789185745.883434:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879477632 00000100:00100000:1.0:1789185745.883515:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 35 00000100:00100000:1.0:1789185745.883528:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879477632:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185745.883555:0:9819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185745.883591:0:9819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ec6 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185745.883629:0:9819:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4ced1, blocks: 0x0 00010000:00010000:1.0:1789185745.883669:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:1.0:1789185745.883674:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185745.883685:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ec6 expref: 6 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.883737:0:9819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ec6 expref: 6 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.883754:0:9819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9400, rc 0) 00000100:00100000:1.0:1789185745.883844:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879477632:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 318us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185745.883852:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 35 00000100:00100000:3.0:1789185745.889157:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185745.895214:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879477888 00000100:00100000:0.0:1789185745.895239:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879477888 00000100:00100000:0.0:1789185745.895358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 89 00000100:00100000:0.0:1789185745.895372:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+23:11302:x1876096879477888:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789185745.895559:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+23:11302:x1876096879477888:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 189us (6418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185745.895583:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 89 00000100:00100000:3.0:1789185745.899806:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185745.900805:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879478016 00000100:00100000:0.0:1789185745.900822:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879478016 00000100:00100000:0.0:1789185745.901104:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 36 00000100:00100000:0.0:1789185745.901120:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:11302:x1876096879478016:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185745.901150:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185745.901179:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ecd expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.901228:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ec6 expref: 7 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.901239:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185745.901244:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185745.901250:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.901308:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ec6 expref: 7 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185745.901325:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ec6 expref: 7 pid: 9819 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185745.901345:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ffa80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876096898442112:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185745.901482:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185745.908982:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185745.913700:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ffa80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876096898442112:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185745.913762:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.913793:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db600, rc 0) 00000100:00100000:1.0:1789185745.913935:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:11302:x1876096879478016:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 12818us (14141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185745.913946:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 36 00000100:00100000:3.0:1789185745.914203:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879478144 00000100:00100000:3.0:1789185745.914215:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879478144 00010000:00010000:3.0:1789185745.914266:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ec6 expref: 7 pid: 9819 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185745.914314:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:3.0:1789185745.914324:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879478144:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185745.914344:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185745.914377:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ec6 expref: 7 pid: 9819 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185745.914394:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ec6 expref: 7 pid: 9819 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185745.914452:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045402116/0xda5c730d5a733cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ec6 expref: 7 pid: 9819 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185745.914469:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185745.914474:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185745.914484:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185745.914496:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185745.914541:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185745.914560:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1876096898442240:192.168.204.48@tcp:105: 00000100:00100000:3.0:1789185745.914640:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7fcc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789185745.916949:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1876096898442240:192.168.204.48@tcp:105: 00010000:00010000:3.0:1789185745.916983:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185745.917058:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879478144:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 2733us (8095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185745.917072:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:0.0:1789185745.918842:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185745.919381:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879478272 00000100:00100000:3.0:1789185745.919396:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879478272 00002000:00100000:3.0:1789185745.919453:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff98f2f758ca80 x1876096879478272/t0(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:346/0 lens 504/0 e 0 to 0 dl 1789185756 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789185745.919487:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f2f758ca80 with x1876096879478272 ext(0->8) 00002000:00010000:3.0:1789185745.919494:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f2f758ca80 00000100:00100000:3.0:1789185745.920963:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:3.0:1789185745.920987:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879478272:12345-192.168.204.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789185745.930518:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879478272:12345-192.168.204.48@tcp:4:lhsmtool_posix.0 Request processed in 9517us (11663us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789185745.930540:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 0 00002000:00100000:2.0:1789185745.930561:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff98f2f758ca80 x1876096879478272/t4294967303(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:346/0 lens 504/448 e 0 to 0 dl 1789185756 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185745.930573:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f2f758ca80 with x1876096879478272 ext(0->8) 00002000:00010000:2.0:1789185745.930582:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f2f758ca80 00000100:00100000:0.0:1789185745.944484:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185745.947987:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879478400 00000100:00100000:2.0:1789185745.948013:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879478400 00000100:00100000:2.0:1789185745.948182:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 90 00000100:00100000:2.0:1789185745.948198:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+23:11302:x1876096879478400:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789185745.973417:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1789185745.973436:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:2.0:1789185745.973465:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789185745.973475:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:2.0:1789185745.973478:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.973486:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.973492:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185745.973498:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.973520:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.973539:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:2.0:1789185745.973542:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789185745.973547:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185745.973554:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a733ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789185745.973721:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789185745.973732:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789185745.973740:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185745.973749:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11302:x1876096879478400:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 Request processed in 25551us (29282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185745.973755:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898442368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789185745.973759:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 90 00000100:00100000:3.0:1789185745.973807:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185745.973876:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898442368 00000100:00100000:3.0:1789185745.973884:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898442368 00000100:00100000:3.0:1789185745.973972:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789185745.973982:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898442368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789185745.974193:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789185745.974198:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789185745 00002000:00010000:3.0:1789185745.974200:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789185745.974202:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789185745 -> 1789185745 00002000:00010000:3.0:1789185745.974204:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789185745.974255:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898442368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 274us (448us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789185745.974263:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789185745.974337:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f2ff9fb100/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789185745.974343:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898442368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789185745.979238:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185745.980278:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879478528 00000100:00100000:3.0:1789185745.980300:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879478528 00000100:00100000:3.0:1789185745.980374:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 38 00000100:00100000:3.0:1789185745.980386:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2389:x1876096879478528:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789185745.982846:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1789185745.982873:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1789185745.991326:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879478528:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 Request processed in 10926us (12087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185745.991346:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 38 00000100:00100000:3.0:1789185745.994185:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185745.994357:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879478784 00000100:00100000:1.0:1789185745.994373:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879478784 00000100:00100000:1.0:1789185745.994588:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 91 00000100:00100000:1.0:1789185745.994606:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11302:x1876096879478784:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789185745.994720:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185745.994795:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a733c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ebf expref: 14 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.994825:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:1.0:1789185745.994835:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185745.994994:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.995015:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.995029:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185745.995213:0:6513:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fe03306c reply state 00000000f0747992 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.995229:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185745.995237:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:1.0:1789185745.995240:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789185745.995243:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185745.995382:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+15:11302:x1876096879478784:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 781us (1208us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789185745.995391:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 91 00000100:00100000:3.0:1789185746.004096:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185746.004149:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879478912 00000100:00100000:3.0:1789185746.004164:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879478912 00000100:00100000:3.0:1789185746.004235:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 39 00000100:00100000:3.0:1789185746.004250:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879478912:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789185746.004482:0:9819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789185746.004486:0:9819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789185745 -> 1789185744 00002000:00010000:3.0:1789185746.004489:0:9819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789185742 00002000:00010000:3.0:1789185746.004493:0:9819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789185745 -> 1789185744 00002000:00010000:3.0:1789185746.004496:0:9819:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789185746.004577:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879478912:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 329us (496us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789185746.004587:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 39 00000100:00100000:2.0:1789185746.013310:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.013556:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879479168 00000100:00100000:1.0:1789185746.013579:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879479168 00000100:00100000:1.0:1789185746.013697:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 92 00000100:00100000:1.0:1789185746.013711:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+15:11302:x1876096879479168:12345-192.168.204.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789185746.013849:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.013877:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb1 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.013889:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789185746.014021:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789185746.014159:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb1 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.014175:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb1 expref: 15 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.014191:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876096898442496:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185746.014370:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185746.021527:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.021758:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876096898442496:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185746.021797:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.021887:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879479296 00000100:00100000:3.0:1789185746.021948:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879479296 00010000:00010000:3.0:1789185746.022007:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb1 expref: 16 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.022052:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:3.0:1789185746.022064:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+16:2391:x1876096879479296:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185746.022086:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185746.022116:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb1 expref: 16 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.022133:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb1 expref: 16 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.022164:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a733a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb1 expref: 16 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.022186:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:3.0:1789185746.022192:0:10394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.022205:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.022214:0:10394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.022239:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185746.022316:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+15:2391:x1876096879479296:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 253us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185746.022326:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 60 00010000:00010000:1.0:1789185746.022624:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.022635:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.022691:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.022715:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.022723:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.022730:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.022736:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.022746:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.022758:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:1.0:1789185746.022761:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789185746.022766:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.022771:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a733e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.022846:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11302:x1876096879479168:12345-192.168.204.48@tcp:55:lhsmtool_posix.0 Request processed in 9138us (9545us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789185746.022856:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 92 00000100:00100000:2.0:1789185746.039801:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185746.044456:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879479424 00000100:00100000:0.0:1789185746.044476:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879479424 00000100:00100000:0.0:1789185746.044575:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 40 00000100:00100000:0.0:1789185746.044589:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2389:x1876096879479424:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789185746.044660:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.044703:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.044714:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185746.044720:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185746.044725:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.044780:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.044799:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 7 pid: 8429 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185746.044819:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876096898442624:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185746.045000:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185746.048381:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185746.048444:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879479552 00000100:00100000:3.0:1789185746.048458:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879479552 00010000:00010000:3.0:1789185746.048516:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 8 pid: 8429 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.048581:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:3.0:1789185746.048619:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879479552:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185746.048640:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185746.048672:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 8 pid: 8429 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.048689:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 8 pid: 8429 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.048724:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185746.048729:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185746.048737:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.048750:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.048777:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185746.048852:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879479552:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 237us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185746.048861:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 61 00010000:00010000:0.0:1789185746.050949:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a733d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ecd expref: 7 pid: 8429 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185746.050983:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876096898442624:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185746.051017:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.051032:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.051060:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.051101:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.051112:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.051122:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.051130:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dbc00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185746.051134:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.051145:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.051173:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185746.051181:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a733eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185746.051297:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879479424:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 Request processed in 6711us (11512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185746.051307:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 40 00000100:00100000:2.0:1789185746.067273:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185746.067331:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879479808 00000100:00100000:2.0:1789185746.067346:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879479808 00000100:00100000:2.0:1789185746.068047:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 93 00000100:00100000:2.0:1789185746.068063:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11302:x1876096879479808:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789185746.068198:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.068220:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e56 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.068234:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.068286:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e56 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.068304:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e56 expref: 14 pid: 6514 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185746.068324:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898442752:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185746.069155:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185746.079219:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.079326:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879479936 00000100:00100000:1.0:1789185746.079340:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879479936 00010000:00010000:1.0:1789185746.079399:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e56 expref: 15 pid: 6514 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.079468:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 62 00000100:00100000:1.0:1789185746.079487:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+15:2391:x1876096879479936:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185746.079510:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185746.079518:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e56 expref: 15 pid: 6514 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.079533:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e56 expref: 15 pid: 6514 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.079689:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185746.079697:0:10394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.079711:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.079721:0:10394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.079748:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185746.079840:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+15:2391:x1876096879479936:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 355us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185746.079849:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 62 00010000:00010000:3.0:1789185746.080688:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a73232 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e56 expref: 14 pid: 6514 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.080717:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898442752:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185746.080746:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.080776:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.080784:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.081070:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.081085:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb8 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.081095:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.081139:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb8 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.081155:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb8 expref: 14 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.081171:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898442880:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185746.081284:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185746.086140:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898442880:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185746.086191:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.094287:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185746.094877:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879480064 00000100:00100000:2.0:1789185746.094902:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879480064 00010000:00010000:2.0:1789185746.094982:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb8 expref: 15 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185746.095038:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 63 00000100:00100000:2.0:1789185746.095051:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+15:2391:x1876096879480064:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185746.095073:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185746.095081:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb8 expref: 15 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.095107:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb8 expref: 15 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.095136:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a733b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51eb8 expref: 15 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.095156:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:2.0:1789185746.095162:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.095173:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.095182:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.095211:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185746.095293:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+14:2391:x1876096879480064:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 244us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185746.095302:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 63 00010000:00010000:1.0:1789185746.095392:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.095423:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185746.095583:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1789185746.095776:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1789185746.095819:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1789185746.095963:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898443008:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789185746.096042:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185746.096080:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185746.096110:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898443008 00000100:00100000:1.0:1789185746.096115:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898443008 00000100:00100000:1.0:1789185746.096157:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789185746.096168:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9473:x1876096898443008:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789185746.096264:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9473:x1876096898443008:12345-0@lo:1000:mdt00_004.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185746.096272:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789185746.096318:0:9473:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789185746.096324:0:9473:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f2ff9fb100, transno 4294967304 00000100:00100000:1.0:1789185746.096346:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898443008:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789185746.096485:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1789185746.096530:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898443136:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789185746.096563:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185746.096587:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48000 going to sleep for 11 seconds 00000100:00100000:0.0:1789185746.097551:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898443136 00000100:00100000:0.0:1789185746.097566:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898443136 00000100:00100000:0.0:1789185746.097644:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789185746.097656:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9473:x1876096898443136:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789185746.097929:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9473:x1876096898443136:12345-0@lo:1000:mdt00_004.0 Request processed in 253us (1342us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789185746.097937:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789185746.098138:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898443136:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1789185746.098214:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098253:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098262:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098268:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185746.098274:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098285:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098305:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:3.0:1789185746.098309:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185746.098315:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098323:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a733f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098367:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098374:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098380:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098385:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185746.098396:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098473:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098484:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185746.098487:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185746.098490:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098497:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a7332e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098526:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098544:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e9c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098555:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098599:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e9c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.098618:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e9c expref: 17 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.098636:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898443264:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185746.098835:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c4fc1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185746.108500:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185746.108742:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879480192 00000100:00100000:3.0:1789185746.108758:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879480192 00010000:00010000:3.0:1789185746.108814:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e9c expref: 18 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.108872:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 64 00000100:00100000:3.0:1789185746.108886:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:2392:x1876096879480192:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185746.108938:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185746.108948:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e9c expref: 18 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.108964:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e9c expref: 18 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.108985:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898443264:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185746.108996:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7334a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51e9c expref: 18 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.109016:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:3.0:1789185746.109023:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.109069:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.109080:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109098:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.109109:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185746.109125:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109133:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109149:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109157:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109165:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109172:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.109178:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.109181:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+17:2392:x1876096879480192:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 297us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185746.109202:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 64 00010000:00010000:1.0:1789185746.109260:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109273:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185746.109277:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185746.109283:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109291:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73400 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109305:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109320:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109328:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109335:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.109338:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109345:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109354:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f2d703de00) 00010000:00010000:1.0:1789185746.109357:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185746.109360:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.109365:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a733f2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.110987:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11302:x1876096879479808:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 42916us (43718us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789185746.111006:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 93 00000020:00080000:1.0:1789185746.111014:0:9473:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789185746.112413:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185746.112423:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185746.112463:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789185746.112474:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789185746.119128:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.119198:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879480448 00000100:00100000:1.0:1789185746.119216:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879480448 00000100:00100000:1.0:1789185746.119303:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:1.0:1789185746.119316:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11302:x1876096879480448:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789185746.120339:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789185746.120386:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1789185746.120742:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.120770:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.120788:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.120801:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.120809:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.120816:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.120900:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789185746.121075:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11302:x1876096879480448:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 1757us (1964us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789185746.121086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 20 00000020:00080000:1.0:1789185746.121094:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789185746.121242:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185746.121252:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.121261:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185746.121266:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.121276:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.121294:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:3.0:1789185746.121298:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789185746.121305:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.121312:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a73407 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.121326:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.121329:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185746.121330:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185746.216140:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185746.522821:0:14220:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185746.522838:0:14220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185746.522872:0:14220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789185746.524337:0:14220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789185746.688164:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.689211:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879480704 00000100:00100000:1.0:1789185746.689230:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879480704 00000100:00100000:1.0:1789185746.689417:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 94 00000100:00100000:1.0:1789185746.689431:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:11312:x1876096879480704:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185746.689479:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185746.689508:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7340e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ed4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.689676:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73415 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.689704:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.689721:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185746.689736:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789185746.689897:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7340e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ed4 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.690215:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73415 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ed4 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.690226:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185746.690230:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789185746.690235:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8800, rc 0) 00000100:00100000:1.0:1789185746.690571:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+20:11312:x1876096879480704:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1142us (2419us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789185746.690581:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 94 00000100:00100000:3.0:1789185746.696227:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.696809:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879480832 00000100:00100000:1.0:1789185746.696823:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879480832 00000100:00100000:1.0:1789185746.696925:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 95 00000100:00100000:1.0:1789185746.696944:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+20:11312:x1876096879480832:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:1.0:1789185746.697239:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.697264:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.697291:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.697312:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.697319:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.697326:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.697573:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.697583:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.697591:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185746.697654:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.697671:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698218:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698232:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698241:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.698247:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698256:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698383:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185746.698388:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185746.698396:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698403:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73423 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698495:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698503:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698510:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698516:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.698530:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698538:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698546:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f300ff3d00) 00010000:00010000:1.0:1789185746.698549:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185746.698552:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698558:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7342a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698580:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698587:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698593:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698599:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.698602:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698608:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698615:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3200) 00010000:00010000:1.0:1789185746.698617:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185746.698626:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.698632:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73431 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.699803:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+20:11312:x1876096879480832:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 2846us (3576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185746.699820:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 95 00000100:00100000:3.0:1789185746.767677:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.769599:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879481088 00000100:00100000:1.0:1789185746.769623:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879481088 00000100:00100000:1.0:1789185746.769721:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 96 00000100:00100000:1.0:1789185746.769734:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+20:11315:x1876096879481088:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185746.769764:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185746.769790:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73438 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51edb expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.769904:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.769941:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.769954:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.769971:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.769978:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.769999:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771547:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771572:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771584:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185746.771597:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789185746.771713:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771722:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771729:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771736:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.771741:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771749:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771763:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185746.771766:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185746.771786:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771793:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9400/0xda5c730d5a7343f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771809:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771814:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771819:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771825:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.771828:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771834:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771841:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f300ff3200) 00010000:00010000:1.0:1789185746.771843:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185746.771846:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771851:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a73446 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771955:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9e00/0xda5c730d5a73438 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51edb expref: 23 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771983:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51edb expref: 22 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.771990:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:1.0:1789185746.771992:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185746.771994:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8400, rc 0) 00000100:00100000:1.0:1789185746.774777:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11315:x1876096879481088:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 5027us (8719us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789185746.774794:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 96 00000100:00100000:0.0:1789185746.784634:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.784821:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879481216 00000100:00100000:1.0:1789185746.784837:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879481216 00000100:00100000:1.0:1789185746.784961:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 97 00000100:00100000:1.0:1789185746.784975:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11315:x1876096879481216:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:1.0:1789185746.785077:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.785099:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.785115:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.785160:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.785168:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.785188:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.785195:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9a00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.785200:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.785208:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.785222:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:1.0:1789185746.785226:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185746.785232:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.785239:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9a00/0xda5c730d5a7345b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.785355:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11315:x1876096879481216:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 383us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185746.785364:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 97 00000100:00100000:2.0:1789185746.798723:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185746.798789:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879481472 00000100:00100000:2.0:1789185746.798804:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879481472 00000100:00100000:2.0:1789185746.798893:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:2.0:1789185746.798905:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6595050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11315:x1876096879481472:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:2.0:1789185746.799251:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6595050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+23:11315:x1876096879481472:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 347us (540us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789185746.799269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:0.0:1789185746.849688:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185746.849791:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879481728 00000100:00100000:3.0:1789185746.849807:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879481728 00000100:00100000:3.0:1789185746.849892:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 98 00000100:00100000:3.0:1789185746.849930:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+23:10840:x1876096879481728:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185746.849965:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185746.849996:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73462 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ee2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.850211:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.850232:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51edb expref: 24 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.850243:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.850290:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51edb expref: 24 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185746.850478:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51edb expref: 24 pid: 9473 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185746.850499:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876096898443392:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185746.850628:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d3a09540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185746.857300:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185746.858606:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876096898443392:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185746.858668:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.859062:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879481856 00000100:00100000:1.0:1789185746.859073:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879481856 00010000:00010000:1.0:1789185746.859126:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51edb expref: 25 pid: 9473 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.859168:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00100000:1.0:1789185746.859180:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+25:2391:x1876096879481856:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185746.859200:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185746.859216:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51edb expref: 25 pid: 9473 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.859230:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51edb expref: 25 pid: 9473 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.859267:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a7344d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51edb expref: 25 pid: 9473 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.859287:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:1.0:1789185746.859293:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.859304:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.859312:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.859347:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185746.859436:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+24:2391:x1876096879481856:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 257us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185746.859445:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 65 00010000:00010000:2.0:1789185746.859485:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.859503:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185746.859531:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789185746.859724:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73462 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee2 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.859745:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee2 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.859752:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:2.0:1789185746.859754:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789185746.859757:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dac00, rc 0) 00000100:00100000:2.0:1789185746.859787:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+24:10840:x1876096879481728:12345-192.168.204.48@tcp:101:bash.0 Request processed in 9885us (10120us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789185746.859796:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 98 00000100:00100000:2.0:1789185746.865578:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.868623:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879481984 00000100:00100000:1.0:1789185746.868642:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879481984 00000100:00100000:1.0:1789185746.868793:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 99 00000100:00100000:1.0:1789185746.868807:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+24:10840:x1876096879481984:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:1.0:1789185746.868852:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185746.868892:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73477 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ee9 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.868985:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a7347e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.869003:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a7347e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.869018:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a7347e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.869163:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73477 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee9 expref: 26 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.869183:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a7347e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee9 expref: 25 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.869193:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:1.0:1789185746.869196:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185746.869201:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1400, rc 0) 00000100:00100000:1.0:1789185746.869289:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+25:10840:x1876096879481984:12345-192.168.204.48@tcp:101:bash.0 Request processed in 485us (3729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185746.869296:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 99 00000100:00100000:0.0:1789185746.874241:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185746.874329:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879482240 00000100:00100000:2.0:1789185746.874343:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879482240 00000100:00100000:2.0:1789185746.874419:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 100 00000100:00100000:2.0:1789185746.874432:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+25:10840:x1876096879482240:12345-192.168.204.48@tcp:36:bash.0 00010000:00010000:2.0:1789185746.874795:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.874840:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.874856:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185746.874959:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1789185746.874989:0:6512:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000004f4bc60 reply state 0000000070d3eb15 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.875004:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.875012:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:2.0:1789185746.875015:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185746.875021:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789185746.875062:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1789185746.875198:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+29:10840:x1876096879482240:12345-192.168.204.48@tcp:36:bash.0 Request processed in 768us (970us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789185746.875206:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 100 00000020:00080000:2.0:1789185746.875213:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789185746.879592:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185746.879741:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879482368 00000100:00100000:2.0:1789185746.879756:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879482368 00000100:00100000:2.0:1789185746.879841:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 101 00000100:00100000:2.0:1789185746.879856:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+29:10840:x1876096879482368:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185746.879902:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185746.880140:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7348c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ef0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.880254:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7348c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef0 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.880272:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7348c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef0 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.880294:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:2.0:1789185746.880297:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185746.880302:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e200, rc 0) 00000100:00100000:2.0:1789185746.880385:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+30:10840:x1876096879482368:12345-192.168.204.48@tcp:101:bash.0 Request processed in 534us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185746.880393:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 101 00000100:00100000:3.0:1789185746.888693:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185746.888946:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879482496 00000100:00100000:2.0:1789185746.888964:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879482496 00000100:00100000:2.0:1789185746.889054:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:2.0:1789185746.889068:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:10840:x1876096879482496:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185746.889099:0:9819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185746.889145:0:9819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ef7 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185746.889191:0:9819:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4ced0, atime: 0x6aa4cece, ctime: 0x6aa4ced0, blocks: 0x8 00010000:00010000:2.0:1789185746.889228:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1789185746.889235:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185746.889247:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef7 expref: 7 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.889309:0:9819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef7 expref: 7 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185746.889326:0:9819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e000, rc 0) 00000100:00100000:2.0:1789185746.889401:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:10840:x1876096879482496:12345-192.168.204.48@tcp:101:bash.0 Request processed in 336us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185746.889410:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:0.0:1789185746.892368:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185746.892483:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879482624 00000100:00100000:2.0:1789185746.892570:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879482624 00002000:00010000:2.0:1789185746.892632:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789185746.892638:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c35e0e00 with x1876096879482624 ext(0->18446744073709551615) 00002000:00010000:2.0:1789185746.892654:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c35e0e00. 00000100:00100000:2.0:1789185746.892737:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 1 00000100:00100000:2.0:1789185746.892749:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879482624:12345-192.168.204.48@tcp:10:bash.0 00002000:00010000:2.0:1789185746.893236:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789185746.893241:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789185744 -> 1789185746 00002000:00010000:2.0:1789185746.893245:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789185742 -> 1789185742 00002000:00010000:2.0:1789185746.893247:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789185744 -> 1789185746 00002000:00010000:2.0:1789185746.893250:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789185746.893339:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879482624:12345-192.168.204.48@tcp:10:bash.0 Request processed in 591us (985us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789185746.893347:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 1 00002000:00010000:2.0:1789185746.893352:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789185746.893355:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c35e0e00 with x1876096879482624 ext(0->18446744073709551615) 00002000:00010000:2.0:1789185746.893374:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c35e0e00. 00000100:00100000:0.0:1789185746.983717:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185746.984226:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879482752 00000100:00100000:1.0:1789185746.984242:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879482752 00000100:00100000:1.0:1789185746.984336:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 102 00000100:00100000:1.0:1789185746.984350:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+30:11329:x1876096879482752:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:1.0:1789185746.984458:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984513:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984529:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984550:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984557:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984564:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984658:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984668:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984675:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185746.984732:0:9473:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984744:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984751:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984768:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984774:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.984779:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984789:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984803:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185746.984807:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185746.984813:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984821:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a7349a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984836:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984842:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984848:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984853:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.984855:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984870:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984890:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f300ff3200) 00010000:00010000:1.0:1789185746.984893:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185746.984896:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984902:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a734a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984965:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984973:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984979:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984985:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1a00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185746.984988:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.984995:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.985002:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:1.0:1789185746.985005:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185746.985008:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185746.985025:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a734a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185746.985730:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+30:11329:x1876096879482752:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 1372us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185746.985742:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 102 00000100:00100000:3.0:1789185747.040412:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185747.045036:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879483008 00000100:00100000:0.0:1789185747.045534:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879483008 00000100:00100000:2.0:1789185747.047079:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 103 00000100:00100000:2.0:1789185747.047100:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+30:11332:x1876096879483008:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185747.047134:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185747.047167:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51efe expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047291:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047313:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047329:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047347:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047354:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047361:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047520:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a734c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047530:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a734c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047538:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a734c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185747.047572:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789185747.047686:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047695:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047702:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047709:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185747.047715:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047725:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047740:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185747.047744:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185747.047751:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047759:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a734b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047776:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047782:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047789:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047802:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185747.047805:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047812:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047821:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f2d2ed4200) 00010000:00010000:2.0:1789185747.047823:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185747.047826:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047833:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a734bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047894:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51efe expref: 33 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047982:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a734c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51efe expref: 32 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.047992:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:2.0:1789185747.047995:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789185747.047998:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f200, rc 0) 00000100:00100000:2.0:1789185747.048180:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+32:11332:x1876096879483008:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1084us (8145us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789185747.048190:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 103 00000100:00100000:0.0:1789185747.054371:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.056571:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879483136 00000100:00100000:2.0:1789185747.056622:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879483136 00000100:00100000:2.0:1789185747.056718:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 104 00000100:00100000:2.0:1789185747.056730:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+32:11332:x1876096879483136:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:2.0:1789185747.056824:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.056848:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee2 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.056860:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.057095:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee2 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.057111:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee2 expref: 32 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185747.057128:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876096898443520:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185747.057269:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185747.059734:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876096898443520:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185747.059779:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185747.060506:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.060659:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879483392 00000100:00100000:2.0:1789185747.060670:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879483392 00000100:00100000:2.0:1789185747.060749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:2.0:1789185747.060761:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+33:6161:x1876096879483392:12345-192.168.204.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789185747.061242:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+34:6161:x1876096879483392:12345-192.168.204.48@tcp:35:ldlm_bl.0 Request processed in 480us (741us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789185747.061252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:1.0:1789185747.064654:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.064865:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879483520 00000100:00100000:3.0:1789185747.064892:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879483520 00010000:00010000:3.0:1789185747.064986:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee2 expref: 34 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185747.065039:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 66 00000100:00100000:3.0:1789185747.065051:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+34:2391:x1876096879483520:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185747.065071:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185747.065079:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee2 expref: 34 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.065097:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee2 expref: 34 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.065126:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73469 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee2 expref: 34 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.065150:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:3.0:1789185747.065158:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.065169:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.065201:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.065243:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185747.065331:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+33:2391:x1876096879483520:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 280us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185747.065339:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 66 00010000:00010000:2.0:1789185747.066760:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.066778:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.066843:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.066852:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.066861:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.066869:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185747.066980:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.066990:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.067007:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:2.0:1789185747.067011:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185747.067018:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.067025:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a734d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185747.067158:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+32:11332:x1876096879483136:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 10424us (12801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185747.067167:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 104 00000100:00100000:1.0:1789185747.074137:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.074230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879483776 00000100:00100000:3.0:1789185747.074245:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879483776 00000100:00100000:3.0:1789185747.074318:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:3.0:1789185747.074330:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+32:11332:x1876096879483776:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185747.074719:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+33:11332:x1876096879483776:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 390us (597us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789185747.074729:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:0.0:1789185747.196272:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185747.196386:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879484032 00000100:00100000:1.0:1789185747.196400:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879484032 00000100:00100000:1.0:1789185747.196478:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 105 00000100:00100000:1.0:1789185747.196491:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+33:11343:x1876096879484032:12345-192.168.204.48@tcp:101:cat.0 00010000:00010000:1.0:1789185747.196533:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185747.196568:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a734d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f05 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.196670:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.196690:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.196704:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.196722:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.196730:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.196756:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.196966:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a734ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.196978:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a734ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.196986:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a734ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185747.196999:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789185747.197104:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197113:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197120:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197127:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185747.197132:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197142:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197159:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185747.197162:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185747.197177:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197184:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a734e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197201:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197207:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197212:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197217:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185747.197219:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197225:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197232:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f300ff3200) 00010000:00010000:1.0:1789185747.197234:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185747.197237:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197242:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a734e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197293:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a734d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f05 expref: 36 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197322:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a734ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f05 expref: 35 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.197328:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:1.0:1789185747.197331:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185747.197333:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1800, rc 0) 00000100:00100000:1.0:1789185747.197417:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+35:11343:x1876096879484032:12345-192.168.204.48@tcp:101:cat.0 Request processed in 928us (1159us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789185747.197425:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 105 00000100:00100000:0.0:1789185747.203659:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.203781:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879484288 00000100:00100000:3.0:1789185747.203796:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879484288 00000100:00100000:3.0:1789185747.203897:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:3.0:1789185747.203941:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+35:11343:x1876096879484288:12345-192.168.204.48@tcp:35:cat.0 00000100:00100000:3.0:1789185747.204341:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+36:11343:x1876096879484288:12345-192.168.204.48@tcp:35:cat.0 Request processed in 431us (695us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789185747.204350:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:0.0:1789185747.237051:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.237284:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879484544 00000100:00100000:3.0:1789185747.237298:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879484544 00000100:00100000:3.0:1789185747.237376:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 106 00000100:00100000:3.0:1789185747.237389:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+36:11344:x1876096879484544:12345-192.168.204.48@tcp:36:rm.0 00010000:00010000:3.0:1789185747.237504:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789185747.237746:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7348c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef0 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.237775:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a734ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f05 expref: 35 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.237789:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a734c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51efe expref: 34 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.237802:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a7347e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ee9 expref: 33 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.237813:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:3.0:1789185747.237819:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185747.237850:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.237880:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.237893:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.237977:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.237987:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.238008:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.238124:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.238134:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.238141:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185747.238436:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789185747.238448:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386400539655ns, next at 387400535790ns, rc = 0 00010000:00010000:3.0:1789185747.238510:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.239009:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185747.241049:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241080:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241093:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241101:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241108:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241165:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185747.241203:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241212:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241220:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241227:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185747.241233:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241242:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241258:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:3.0:1789185747.241262:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789185747.241268:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241276:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7350a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241308:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241314:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241319:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241334:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185747.241339:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241346:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241356:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:3.0:1789185747.241358:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185747.241362:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241369:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a734fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185747.241383:0:6513:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c4481573 reply state 000000008867a4e7 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241398:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.241405:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f2d703d300) 00010000:00010000:3.0:1789185747.241408:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185747.241413:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185747.243001:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+34:11344:x1876096879484544:12345-192.168.204.48@tcp:36:rm.0 Request processed in 5599us (5952us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789185747.243018:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 106 00010000:00010000:0.0:1789185747.243262:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185747.243274:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.243286:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185747.243290:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.243301:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.243320:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:0.0:1789185747.243324:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789185747.243329:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.243336:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73511 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.243354:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185747.243356:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185747.243358:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185747.299341:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.299458:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879484800 00000100:00100000:2.0:1789185747.299473:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879484800 00000100:00100000:2.0:1789185747.299586:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 107 00000100:00100000:2.0:1789185747.299600:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+34:11350:x1876096879484800:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185747.299645:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185747.299679:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73518 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.299846:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.300046:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.300066:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.300084:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.300093:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.300099:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185747.301224:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789185747.301454:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.301470:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.301482:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302205:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302218:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302226:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302233:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185747.302239:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302247:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302263:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185747.302266:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185747.302272:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302301:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7351f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185747.302322:0:6514:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bb3af20c reply state 000000005c627ee8 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302339:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302346:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f2d703d300) 00010000:00010000:2.0:1789185747.302349:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185747.302354:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789185747.302409:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73518 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f0c expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302425:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f0c expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.302433:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d2ed4200) 00010000:00010000:2.0:1789185747.302436:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185747.302439:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e400, rc 0) 00000100:00100000:2.0:1789185747.302904:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+37:11350:x1876096879484800:12345-192.168.204.48@tcp:101:bash.0 Request processed in 3304us (3574us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789185747.302965:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 107 00000100:00100000:1.0:1789185747.311187:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.311304:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879484928 00000100:00100000:3.0:1789185747.311317:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879484928 00000100:00100000:3.0:1789185747.311443:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:3.0:1789185747.311471:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879484928:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185747.311498:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185747.311664:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f13 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185747.311702:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185747.311734:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1789185747.311739:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185747.311752:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f13 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.311780:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f13 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.311796:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dac00, rc 0) 00000100:00100000:3.0:1789185747.312009:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879484928:12345-192.168.204.48@tcp:101:bash.0 Request processed in 540us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185747.312018:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00080000:2.0:1789185747.312091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185747.316801:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.317053:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879485056 00000100:00100000:2.0:1789185747.317067:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879485056 00000100:00100000:2.0:1789185747.317174:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 43 00000100:00100000:2.0:1789185747.317187:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+8:11350:x1876096879485056:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185747.317231:0:9819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185747.317256:0:9819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f1a expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.317315:0:9819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f13 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.317325:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185747.317330:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185747.317335:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 9 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.317378:0:9819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f13 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.317394:0:9819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f13 expref: 9 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185747.317411:0:9819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9819:1876096898443648:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185747.317580:0:9819:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185747.321596:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185747.322322:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879485184 00000100:00100000:1.0:1789185747.322339:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879485184 00010000:00010000:1.0:1789185747.322398:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f13 expref: 10 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185747.322459:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:1.0:1789185747.322471:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2392:x1876096879485184:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185747.322493:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185747.322536:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f13 expref: 10 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.322555:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f13 expref: 10 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.322590:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185747.322614:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185747.322625:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 10 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.322639:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 10 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.322687:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 10 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185747.322705:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1876096898443776:192.168.204.48@tcp:105: 00000100:00100000:1.0:1789185747.322818:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48240 going to sleep for 11 seconds 00010000:00010000:2.0:1789185747.325720:0:9819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a7353b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f13 expref: 10 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185747.325757:0:9819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9819:1876096898443648:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185747.325801:0:9819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 9 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.325844:0:9819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f600, rc 0) 00000100:00100000:2.0:1789185747.326157:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+9:11350:x1876096879485056:12345-192.168.204.48@tcp:101:bash.0 Request processed in 8970us (9373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185747.326169:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 43 00000100:00100000:3.0:1789185747.326355:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1876096898443776:192.168.204.48@tcp:105: 00010000:00010000:3.0:1789185747.326378:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185747.326405:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879485184:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 3936us (4826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185747.326415:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:0.0:1789185747.330612:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.330721:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879485440 00000100:00100000:3.0:1789185747.330738:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879485440 00000100:00100000:3.0:1789185747.330887:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:3.0:1789185747.330953:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+37:11350:x1876096879485440:12345-192.168.204.48@tcp:35:bash.0 00000100:00100000:3.0:1789185747.331434:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+38:11350:x1876096879485440:12345-192.168.204.48@tcp:35:bash.0 Request processed in 482us (904us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789185747.331443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:1.0:1789185747.486216:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.489488:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879485568 00000100:00100000:2.0:1789185747.489510:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879485568 00000100:00100000:2.0:1789185747.489694:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 108 00000100:00100000:2.0:1789185747.489707:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+38:11366:x1876096879485568:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185747.489734:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185747.489759:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73549 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f21 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.489855:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73550 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.489880:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.489893:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185747.490551:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789185747.490556:0:8147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185747.491001:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.491041:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f21 expref: 40 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.491337:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f21 expref: 39 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.491469:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185747.491472:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185747.491476:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402fe00, rc 0) 00000100:00100000:2.0:1789185747.491653:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+39:11366:x1876096879485568:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1946us (5449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185747.491662:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 108 00000100:00100000:0.0:1789185747.500793:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.500895:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879485824 00000100:00100000:3.0:1789185747.501121:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879485824 00000100:00100000:3.0:1789185747.501240:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 109 00000100:00100000:3.0:1789185747.501252:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+39:11366:x1876096879485824:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185747.501273:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185747.501294:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73557 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f28 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.501440:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7355e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.501458:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7355e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.501471:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7355e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185747.501483:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789185747.501610:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73557 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f28 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.501628:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7355e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f28 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.501655:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d2ed4200) 00010000:00010000:3.0:1789185747.501658:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185747.501662:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db600, rc 0) 00000100:00100000:3.0:1789185747.501733:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+41:11366:x1876096879485824:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 483us (950us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789185747.501741:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 109 00000100:00100000:0.0:1789185747.513830:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.514104:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879486080 00000100:00100000:2.0:1789185747.514115:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879486080 00000100:00100000:2.0:1789185747.514194:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 110 00000100:00100000:2.0:1789185747.514205:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+41:11366:x1876096879486080:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185747.514232:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185747.514254:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7356c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f2f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.514387:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73573 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.514403:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.514417:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185747.514430:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789185747.515128:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7356c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f2f expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.515149:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73573 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f2f expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.515158:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d2ed4200) 00010000:00010000:2.0:1789185747.515160:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789185747.515164:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e600, rc 0) 00000100:00100000:2.0:1789185747.516897:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+43:11366:x1876096879486080:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 2684us (3067us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1789185747.516927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 110 00000100:00100000:0.0:1789185747.517570:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.518904:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879486208 00000100:00100000:2.0:1789185747.518932:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879486208 00000100:00100000:2.0:1789185747.519000:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:2.0:1789185747.519011:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+43:2392:x1876096879486208:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185747.519030:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185747.519054:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7355e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f28 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.519075:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d2ed4200) 00010000:00010000:2.0:1789185747.519080:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185747.519147:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+42:2392:x1876096879486208:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 137us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185747.519154:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:0.0:1789185747.523627:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185747.523784:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879486336 00000100:00100000:1.0:1789185747.523795:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879486336 00000100:00100000:1.0:1789185747.523858:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 44 00000100:00100000:1.0:1789185747.523882:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2390:x1876096879486336:12345-192.168.204.48@tcp:1:lfs.0 00010000:00010000:1.0:1789185747.523949:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.523979:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 8 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.523988:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185747.523992:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185747.523996:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.524050:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 8 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.524280:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 8 pid: 9819 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185747.524299:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876096898443904:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185747.524395:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48300 going to sleep for 11 seconds 00000100:00100000:0.0:1789185747.532771:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876096898443904:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185747.532817:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185747.534459:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.534565:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879486464 00000100:00100000:2.0:1789185747.534575:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879486464 00002000:00100000:2.0:1789185747.534646:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff98f1c36eed80 x1876096879486464/t0(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:348/0 lens 504/0 e 0 to 0 dl 1789185758 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185747.534657:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c36eed80 with x1876096879486464 ext(0->8) 00010000:00010000:2.0:1789185747.534666:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 9 pid: 9819 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.534683:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 9 pid: 9819 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185747.534692:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f1c36eed80 00000100:00100000:2.0:1789185747.534730:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 1 00000100:00100000:2.0:1789185747.534740:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879486464:12345-192.168.204.48@tcp:4:lfs.0 00000100:00100000:2.0:1789185747.536223:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+11:2391:x1876096879486464:12345-192.168.204.48@tcp:4:lfs.0 Request processed in 1469us (1759us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789185747.536241:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 1 00002000:00100000:2.0:1789185747.536255:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff98f1c36eed80 x1876096879486464/t4294967303(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:348/0 lens 504/448 e 0 to 0 dl 1789185758 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185747.536267:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c36eed80 with x1876096879486464 ext(0->8) 00010000:00010000:2.0:1789185747.536280:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 11 pid: 9819 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.536303:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 11 pid: 9819 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185747.536313:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f1c36eed80 00000100:00100000:1.0:1789185747.545751:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.548003:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879486592 00000100:00100000:3.0:1789185747.548023:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879486592 00010000:00010000:3.0:1789185747.548109:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 11 pid: 9819 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185747.548167:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00100000:3.0:1789185747.548179:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+11:2392:x1876096879486592:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185747.548199:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789185747.548223:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789185747.548226:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789185747 00002000:00010000:3.0:1789185747.548228:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789185747 00002000:00010000:3.0:1789185747.548231:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789185747 00002000:00010000:3.0:1789185747.548234:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789185747.548240:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 11 pid: 9819 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.548256:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 11 pid: 9819 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.548309:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2fa242/0xda5c730d5a73542 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f1a expref: 11 pid: 9819 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.548332:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185747.548337:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185747.548344:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.548355:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.548450:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185747.548545:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2392:x1876096879486592:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 367us (2811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185747.548554:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 68 00010000:00010000:0.0:1789185747.553082:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.553114:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.553162:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.553173:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.553183:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.553190:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185747.553196:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.553206:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.553259:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185747.553431:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000113c37ee/0xda5c730d5a73581 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185747.553642:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2390:x1876096879486336:12345-192.168.204.48@tcp:1:lfs.0 Request processed in 29755us (30016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185747.553656:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 44 00000100:00100000:1.0:1789185747.562514:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.562636:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879486848 00000100:00100000:2.0:1789185747.562651:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879486848 00000100:00100000:2.0:1789185747.562738:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:2.0:1789185747.562752:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6594850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+42:11366:x1876096879486848:12345-192.168.204.48@tcp:35:lfs.0 00000004:00010000:2.0:1789185747.563180:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73573 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f2f expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185747.563632:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789185747.563671:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789185747.566843:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789185747.567182:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.567210:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f0c expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.567220:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.567286:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f0c expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.567308:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f0c expref: 46 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185747.567325:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1876096898444032:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185747.567446:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185747.571986:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1876096898444032:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185747.572035:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185747.572599:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.573325:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879486976 00000100:00100000:2.0:1789185747.573339:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879486976 00010000:00010000:2.0:1789185747.573393:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f0c expref: 47 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185747.573444:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:2.0:1789185747.573457:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+47:2392:x1876096879486976:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185747.573479:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185747.573489:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f0c expref: 47 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.573504:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f0c expref: 47 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.573536:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7352d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f0c expref: 47 pid: 6514 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.573559:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d2ed4200) 00010000:00010000:2.0:1789185747.573566:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.573579:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.573588:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.573629:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185747.573996:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.574007:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185747.574170:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1789185747.574337:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789185747.574460:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876096898444160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789185747.574540:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185747.574589:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b483c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185747.574846:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898444160 00000100:00100000:0.0:1789185747.574854:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898444160 00000100:00100000:0.0:1789185747.574980:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789185747.574991:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1876096898444160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789185747.575093:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1876096898444160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 104us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185747.575101:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789185747.575293:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+48:2392:x1876096879486976:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 1834us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185747.575305:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00080000:1.0:1789185747.577079:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185747.577186:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876096898444160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789185747.577494:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789185747.577596:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876096898444288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789185747.577682:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185747.579543:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898444288 00000100:00100000:2.0:1789185747.579564:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898444288 00000100:00100000:2.0:1789185747.579646:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789185747.579658:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1876096898444288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789185747.584063:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6515:x1876096898444288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 4389us (6362us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789185747.584084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789185747.587389:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48840 going to sleep for 11 seconds 00000100:00100000:1.0:1789185747.587471:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876096898444288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789185747.587596:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789185747.587675:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.587688:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.587696:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.587704:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185747.588800:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.588825:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.589437:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d2ed4200) 00010000:00010000:1.0:1789185747.589443:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789185747.589452:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185747.589462:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73588 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185747.589673:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789185747.590189:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789185747.590205:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386752296560ns, next at 387752292662ns, rc = 0 00000001:00080000:1.0:1789185747.590237:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789185747.590312:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d2ed4200) 00010000:00010000:1.0:1789185747.590317:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789185747.590328:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73573 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f2f expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185747.590498:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6594850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+49:11366:x1876096879486848:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 27747us (27998us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789185747.590511:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 26 00000020:00080000:1.0:1789185747.590519:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789185747.595372:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.595531:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879487104 00000100:00100000:3.0:1789185747.595545:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879487104 00000100:00100000:3.0:1789185747.595623:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 111 00000100:00100000:3.0:1789185747.595635:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+49:11366:x1876096879487104:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185747.595668:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185747.595698:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7358f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.595793:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7358f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f36 expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.595834:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7358f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f36 expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.595881:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185747.595885:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185747.595890:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dba00, rc 0) 00000100:00100000:3.0:1789185747.596019:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+50:11366:x1876096879487104:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 384us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185747.596026:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 111 00000100:00100000:0.0:1789185747.608217:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.608409:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879487360 00000100:00100000:3.0:1789185747.608422:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879487360 00000100:00100000:3.0:1789185747.608512:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:3.0:1789185747.608525:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+50:11366:x1876096879487360:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185747.608878:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+51:11366:x1876096879487360:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 354us (676us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789185747.608887:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:2.0:1789185747.780072:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.780222:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879487488 00000100:00100000:3.0:1789185747.780236:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879487488 00000100:00100000:3.0:1789185747.780331:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 112 00000100:00100000:3.0:1789185747.780346:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+51:11376:x1876096879487488:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:3.0:1789185747.780467:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780494:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780537:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780553:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780561:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780569:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780676:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780686:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780693:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185747.780760:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780777:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780787:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780794:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780815:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185747.780820:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780830:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780845:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:3.0:1789185747.780848:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185747.780855:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780874:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73596 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780892:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.780899:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785516:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785558:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185747.785567:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785580:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785639:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f2d703d300) 00010000:00010000:3.0:1789185747.785643:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185747.785651:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785660:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7359d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785688:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785695:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785702:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785707:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185747.785710:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785716:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785723:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185747.785726:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185747.785729:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.785735:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185747.788994:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+51:11376:x1876096879487488:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 8631us (8916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185747.789014:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 112 00000100:00100000:0.0:1789185747.848033:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185747.848413:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879487744 00000100:00100000:2.0:1789185747.848427:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879487744 00000100:00100000:2.0:1789185747.848505:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 113 00000100:00100000:2.0:1789185747.848518:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+51:11380:x1876096879487744:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185747.848555:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185747.848583:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a735ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.848688:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.848706:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.848725:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.848739:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.848766:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.848774:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.850782:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a735c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.850822:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a735c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.850840:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a735c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185747.850876:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789185747.851085:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851094:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851101:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851108:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402ea00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185747.851114:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851122:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851153:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185747.851156:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185747.851163:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851169:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a735b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851186:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851193:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851199:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851204:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185747.851207:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851213:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851220:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f2d703d300) 00010000:00010000:2.0:1789185747.851223:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185747.851227:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851233:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.851310:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a735ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f3d expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.852708:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a735c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f3d expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185747.852719:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:2.0:1789185747.852721:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185747.852725:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e400, rc 0) 00000100:00100000:2.0:1789185747.853894:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+53:11380:x1876096879487744:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 4324us (4821us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789185747.856167:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 113 00000100:00100000:1.0:1789185747.856795:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.861216:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879487872 00000100:00100000:3.0:1789185747.861246:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879487872 00000100:00100000:3.0:1789185747.861372:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 114 00000100:00100000:3.0:1789185747.861387:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+53:11380:x1876096879487872:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:3.0:1789185747.861511:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.861652:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.861673:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.861735:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.861745:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.861755:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.861764:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185747.861770:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.861781:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.861799:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185747.861822:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185747.861831:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185747.861838:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185747.862006:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+53:11380:x1876096879487872:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 620us (5214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185747.862016:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 114 00000100:00100000:0.0:1789185747.873175:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185747.880789:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879488128 00000100:00100000:3.0:1789185747.880810:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879488128 00000100:00100000:0.0:1789185747.886494:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:0.0:1789185747.886514:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+53:11380:x1876096879488128:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:0.0:1789185747.886972:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+54:11380:x1876096879488128:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 460us (13812us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1789185747.886982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:0.0:1789185748.011688:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.011789:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879488384 00000100:00100000:1.0:1789185748.011803:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879488384 00000100:00100000:1.0:1789185748.012012:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 115 00000100:00100000:1.0:1789185748.012026:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+54:11390:x1876096879488384:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:1.0:1789185748.012078:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185748.012083:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789185748.012120:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73550 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f21 expref: 54 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.012146:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185748.012153:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185748.012171:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a735d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.012328:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a735dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.012373:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a735dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.012389:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a735dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185748.012403:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789185748.012676:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a735d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f44 expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.012695:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a735dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f44 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.012703:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:1.0:1789185748.012706:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185748.012709:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1c00, rc 0) 00000100:00100000:1.0:1789185748.012793:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+55:11390:x1876096879488384:12345-192.168.204.48@tcp:101:bash.0 Request processed in 770us (1121us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789185748.012803:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 115 00000100:00080000:2.0:1789185748.014179:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185748.016146:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.016204:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.016363:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879488512 00000100:00100000:0.0:1789185748.016376:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879488512 00000100:00100000:0.0:1789185748.016468:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:0.0:1789185748.016481:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+55:2392:x1876096879488512:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185748.016505:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185748.016539:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a735dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f44 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.016565:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:0.0:1789185748.016573:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185748.016643:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+54:2392:x1876096879488512:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 164us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185748.016651:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:3.0:1789185748.016841:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879488640 00000100:00100000:3.0:1789185748.016847:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879488640 00000100:00100000:3.0:1789185748.016900:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 116 00000100:00100000:3.0:1789185748.016933:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+54:11390:x1876096879488640:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185748.016960:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185748.016980:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.017020:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.017036:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.017049:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.017214:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a735ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f4b expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.017248:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f4b expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.017256:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.017259:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185748.017262:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db600, rc 0) 00000100:00100000:3.0:1789185748.017303:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+55:11390:x1876096879488640:12345-192.168.204.48@tcp:101:bash.0 Request processed in 396us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.017309:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 116 00000100:00100000:2.0:1789185748.021225:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.021542:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879488896 00000100:00100000:3.0:1789185748.021557:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879488896 00000100:00100000:3.0:1789185748.021636:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 117 00000100:00100000:3.0:1789185748.021649:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+55:11390:x1876096879488896:12345-192.168.204.48@tcp:36:bash.0 00010000:00010000:3.0:1789185748.021723:0:8147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185748.021759:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a735c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f3d expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.021783:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.021790:0:8147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185748.022792:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.023337:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.023354:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185748.023466:0:8147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789185748.023510:0:8147:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000352e26b reply state 000000000cff3092 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.023634:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.023643:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.023647:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185748.023652:0:8147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185748.023882:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+57:11390:x1876096879488896:12345-192.168.204.48@tcp:36:bash.0 Request processed in 2230us (2668us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789185748.023893:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 117 00000020:00080000:3.0:1789185748.023900:0:8147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789185748.029099:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.029232:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879489024 00000100:00100000:2.0:1789185748.029247:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879489024 00000100:00100000:2.0:1789185748.029356:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 118 00000100:00100000:2.0:1789185748.029369:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+57:11390:x1876096879489024:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185748.029403:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185748.029430:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.029635:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.029678:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.029693:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185748.029736:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789185748.029742:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185748.029768:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.029802:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a735ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f52 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.029824:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f52 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.029833:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:2.0:1789185748.029836:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185748.029841:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ea00, rc 0) 00000100:00100000:2.0:1789185748.030177:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+58:11390:x1876096879489024:12345-192.168.204.48@tcp:101:bash.0 Request processed in 809us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.030186:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 118 00000100:00100000:0.0:1789185748.036187:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.036315:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879489280 00000100:00100000:1.0:1789185748.036334:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879489280 00000100:00100000:1.0:1789185748.036458:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00100000:1.0:1789185748.036477:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+58:11390:x1876096879489280:12345-192.168.204.48@tcp:35:bash.0 00000100:00100000:1.0:1789185748.037203:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+59:11390:x1876096879489280:12345-192.168.204.48@tcp:35:bash.0 Request processed in 727us (1134us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789185748.037216:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00100000:1.0:1789185748.111773:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.111973:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879489408 00000100:00100000:0.0:1789185748.111989:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879489408 00000100:00100000:0.0:1789185748.112073:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 119 00000100:00100000:0.0:1789185748.112089:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+59:11396:x1876096879489408:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185748.112125:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185748.112157:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a7360d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f59 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.112270:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a73614 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.112289:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a73614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.112305:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a73614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185748.112366:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789185748.112371:0:9473:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185748.112400:0:9473:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a73614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.112433:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a7360d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f59 expref: 61 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.112457:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a73614 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f59 expref: 60 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.112468:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:0.0:1789185748.112472:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185748.112476:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dae00, rc 0) 00000100:00100000:0.0:1789185748.112759:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+60:11396:x1876096879489408:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 673us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185748.112769:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 119 00000100:00100000:3.0:1789185748.118222:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.118398:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879489536 00000100:00100000:2.0:1789185748.118412:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879489536 00000100:00100000:2.0:1789185748.118507:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 120 00000100:00100000:2.0:1789185748.118521:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+60:11396:x1876096879489536:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185748.118551:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185748.118599:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a7361b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f60 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.118693:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.118713:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.118730:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.118743:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.118752:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.118758:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.118878:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.118889:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.118897:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185748.118993:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789185748.119000:0:8147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185748.119029:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119319:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119332:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119340:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119348:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119356:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185748.119362:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119371:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119386:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185748.119389:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185748.119396:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119403:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a73622 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119421:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119429:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119447:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119453:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185748.119456:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119463:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119471:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f2d703d300) 00010000:00010000:2.0:1789185748.119474:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185748.119478:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119485:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73629 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119518:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a7361b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f60 expref: 62 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119535:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f60 expref: 61 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.119542:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:2.0:1789185748.119545:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185748.119547:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f800, rc 0) 00000100:00100000:2.0:1789185748.119690:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11396:x1876096879489536:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1171us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.119708:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 120 00000100:00100000:2.0:1789185748.122506:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.122603:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879489792 00000100:00100000:3.0:1789185748.122619:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879489792 00000100:00100000:3.0:1789185748.122713:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 121 00000100:00100000:3.0:1789185748.122727:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11396:x1876096879489792:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185748.122758:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185748.122788:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73637 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f67 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.123276:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.123296:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f52 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.123321:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f60 expref: 62 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.123332:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.123381:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f60 expref: 62 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.123399:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f60 expref: 62 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.123416:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898444416:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185748.123561:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f52 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.123572:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f52 expref: 62 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.123582:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898444544:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185748.123610:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185748.129470:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.129573:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.129720:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879489920 00000100:00100000:2.0:1789185748.129738:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879489920 00010000:00010000:3.0:1789185748.129771:0:6512:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.48@tcp) returned -22 from blocking AST (req@000000007479fb53 x1876096898444416) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f60 expref: 63 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.129802:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f60 expref: 63 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.129803:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f60 expref: 63 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.129877:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73630 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f60 expref: 63 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.129943:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879490048 00000100:00100000:2.0:1789185748.129948:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879490048 00010000:00010000:2.0:1789185748.129962:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f52 expref: 63 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.129974:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898444416:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185748.129994:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898444544:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185748.130030:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.130037:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.130050:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185748.130076:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 70 00010000:00010000:3.0:1789185748.130078:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185748.130090:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+63:2392:x1876096879489920:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185748.130116:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185748.130120:0:6496:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie da5c730d5a73630) 00010000:00010000:1.0:1789185748.130122:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185748.130208:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+63:2392:x1876096879489920:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 122us (760us total) trans 0 rc 116/116 00000100:00100000:1.0:1789185748.130216:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 70 00000100:00100000:1.0:1789185748.130241:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 71 00000100:00100000:1.0:1789185748.130257:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+62:2392:x1876096879490048:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185748.130266:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185748.130272:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f52 expref: 62 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.130283:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f52 expref: 62 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.130296:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73606 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f52 expref: 62 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.130308:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:1.0:1789185748.130312:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.130321:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.130343:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.130369:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185748.130392:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+61:2392:x1876096879490048:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 144us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.130398:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 71 00010000:00010000:3.0:1789185748.130509:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.130518:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185748.130551:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789185748.130757:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73637 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f67 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.130776:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f67 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.130797:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.130800:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185748.130803:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185748.130835:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11396:x1876096879489792:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 8112us (8346us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789185748.130842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 121 00000100:00100000:0.0:1789185748.134602:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.134689:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879490304 00000100:00100000:1.0:1789185748.134703:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879490304 00000100:00100000:1.0:1789185748.134834:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:1.0:1789185748.134849:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11396:x1876096879490304:12345-192.168.204.48@tcp:103:lfs.0 00010000:00010000:1.0:1789185748.134884:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185748.134958:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7358f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f36 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.134985:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:1.0:1789185748.134994:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185748.135076:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+60:11396:x1876096879490304:12345-192.168.204.48@tcp:103:lfs.0 Request processed in 231us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.135086:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:3.0:1789185748.137717:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.137848:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879490432 00000100:00100000:1.0:1789185748.137871:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879490432 00000100:00100000:1.0:1789185748.138199:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 122 00000100:00100000:1.0:1789185748.138214:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+60:11396:x1876096879490432:12345-192.168.204.48@tcp:58:lfs.0 00010000:00010000:1.0:1789185748.138424:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.138461:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.138479:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789185748.138785:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789185748.139242:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+60:11396:x1876096879490432:12345-192.168.204.48@tcp:58:lfs.0 Request processed in 1025us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.139255:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 122 00000100:00100000:2.0:1789185748.142309:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.142424:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879490560 00000100:00100000:3.0:1789185748.142439:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879490560 00000100:00100000:3.0:1789185748.142674:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 123 00000100:00100000:3.0:1789185748.142689:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+60:11396:x1876096879490560:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185748.142727:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185748.142762:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f6e expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.143039:0:8147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.143055:0:8147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f6e expref: 61 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.143512:0:8147:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.143636:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f6e expref: 61 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.143655:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:2.0:1789185748.143660:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185748.143664:0:8147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f6e expref: 61 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.143674:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c13a2000, rc 0) 00000100:00100000:2.0:1789185748.143804:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11396:x1876096879490560:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1118us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.143814:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 123 00000040:00080000:3.0:1789185748.198260:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185748.198279:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185748.198330:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789185748.198341:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789185748.198565:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898444672:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789185748.200228:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185748.206400:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898444672:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185748.206701:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.207606:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879490688 00000100:00100000:3.0:1789185748.207622:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879490688 00000100:00100000:3.0:1789185748.207713:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 124 00000100:00100000:3.0:1789185748.207725:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11397:x1876096879490688:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789185748.207771:0:6512:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185748.208536:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11397:x1876096879490688:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 808us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.208546:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 124 00000100:00100000:0.0:1789185748.224170:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.232185:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879490816 00000100:00100000:1.0:1789185748.232208:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879490816 00000100:00100000:1.0:1789185748.232364:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 125 00000100:00100000:1.0:1789185748.232378:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11397:x1876096879490816:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789185748.232489:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232511:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232525:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232541:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232548:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232555:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232599:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232609:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232616:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185748.232679:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789185748.232683:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185748.232698:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232711:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232718:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232726:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232733:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185748.232738:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232745:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232758:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:1.0:1789185748.232766:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185748.232774:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232780:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7365a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232797:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232803:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232809:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232814:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1c00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185748.232817:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232823:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232829:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff98f300ff3200) 00010000:00010000:1.0:1789185748.232831:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185748.232833:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232838:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73661 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232865:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232877:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232883:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232888:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0c00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185748.232891:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232896:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232904:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:1.0:1789185748.232933:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185748.232937:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.232943:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73668 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185748.233055:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11397:x1876096879490816:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 Request processed in 679us (8901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.233064:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 125 00000100:00100000:2.0:1789185748.238372:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.238723:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879491072 00000100:00100000:0.0:1789185748.238739:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879491072 00000100:00100000:0.0:1789185748.238812:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 126 00000100:00100000:0.0:1789185748.238824:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+61:11397:x1876096879491072:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185748.238871:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185748.238903:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da000/0xda5c730d5a7366f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f75 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239091:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239114:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239130:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185748.239146:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789185748.239252:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239261:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239267:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239274:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185748.239279:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239288:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239329:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:0.0:1789185748.239333:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789185748.239340:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239348:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239409:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da000/0xda5c730d5a7366f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f75 expref: 63 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239422:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:0.0:1789185748.239425:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185748.239430:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da000/0xda5c730d5a7366f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f75 expref: 63 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.239441:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021da000, rc 0) 00000100:00100000:0.0:1789185748.239518:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+62:11397:x1876096879491072:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 696us (1164us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1789185748.239527:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 126 00000100:00100000:2.0:1789185748.245115:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.245269:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879491200 00000100:00100000:3.0:1789185748.245284:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879491200 00000100:00100000:3.0:1789185748.245378:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 127 00000100:00100000:3.0:1789185748.245392:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f270b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+62:11397:x1876096879491200:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789185748.245453:0:6512:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185748.245623:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f270b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+62:11397:x1876096879491200:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 233us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.245632:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 127 00000100:00100000:0.0:1789185748.257033:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.257341:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879491456 00000100:00100000:2.0:1789185748.257356:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879491456 00000100:00100000:2.0:1789185748.257435:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 128 00000100:00100000:2.0:1789185748.257448:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+62:11397:x1876096879491456:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185748.257478:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185748.257482:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789185748.257519:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a73614 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f59 expref: 62 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.257546:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185748.257552:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185748.257572:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73684 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185748.258391:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789185748.258581:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7368b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.258598:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7368b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.258610:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7368b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.258675:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73684 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f7c expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.258718:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7368b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f7c expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.258727:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2fae07c00) 00010000:00010000:2.0:1789185748.258730:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185748.258733:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e200, rc 0) 00000100:00100000:2.0:1789185748.259105:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+63:11397:x1876096879491456:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 1657us (2086us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789185748.259115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 128 00010000:00010000:3.0:1789185748.264398:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185748.268820:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.269256:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879491712 00000100:00100000:3.0:1789185748.269271:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879491712 00000100:00100000:3.0:1789185748.269354:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 129 00000100:00100000:3.0:1789185748.269367:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+63:11397:x1876096879491712:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789185748.269450:0:8147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185748.269487:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7368b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f7c expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.269656:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2fae07c00) 00010000:00010000:3.0:1789185748.269674:0:8147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185748.269706:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.269726:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.269739:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.269759:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.269766:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.269774:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.269833:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.269841:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270126:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270132:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.270138:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270157:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270167:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:3.0:1789185748.270171:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185748.270176:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270182:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73699 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270195:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270202:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270209:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270215:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.270218:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270225:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270232:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x7a26be89 (ffff98f2d703d400) 00010000:00010000:3.0:1789185748.270235:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185748.270237:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.270255:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7a26be89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.270383:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+62:11397:x1876096879491712:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 1015us (1576us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789185748.270390:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 129 00000100:00100000:0.0:1789185748.281055:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.281224:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879491840 00000100:00100000:3.0:1789185748.281239:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879491840 00000100:00100000:3.0:1789185748.281331:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 130 00000100:00100000:3.0:1789185748.281344:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+62:11397:x1876096879491840:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185748.281372:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185748.281403:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f83 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.281452:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.281471:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.281486:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.281656:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f83 expref: 64 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.281681:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f83 expref: 63 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.281704:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:3.0:1789185748.281708:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185748.281712:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dba00, rc 0) 00000100:00100000:3.0:1789185748.281796:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+63:11397:x1876096879491840:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 454us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.281804:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 130 00000100:00100000:0.0:1789185748.287722:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.288081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879492096 00000100:00100000:2.0:1789185748.288097:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879492096 00000100:00100000:2.0:1789185748.288183:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 131 00000100:00100000:2.0:1789185748.288196:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+63:11397:x1876096879492096:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185748.288315:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.288337:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.288350:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185748.288586:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1789185748.288602:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387450693005ns, next at 388450686260ns, rc = 0 00000004:00010000:2.0:1789185748.288667:0:6514:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006e7b5786 reply state 000000008870f678 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.289599:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.289612:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:2.0:1789185748.289616:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789185748.289622:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185748.290050:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+65:11397:x1876096879492096:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 1852us (2340us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789185748.290061:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 131 00000100:00100000:2.0:1789185748.299154:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.299316:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879492224 00000100:00100000:3.0:1789185748.299336:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879492224 00000100:00100000:3.0:1789185748.299494:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 132 00000100:00100000:3.0:1789185748.299510:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+65:11397:x1876096879492224:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185748.299550:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185748.299581:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f8a expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.299673:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f8a expref: 66 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.299693:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f8a expref: 66 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.299722:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:3.0:1789185748.299726:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185748.299734:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dac00, rc 0) 00000100:00100000:3.0:1789185748.299835:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+66:11397:x1876096879492224:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 329us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.299886:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 132 00000100:00100000:0.0:1789185748.304685:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.304858:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879492352 00000100:00100000:3.0:1789185748.304873:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879492352 00000100:00100000:3.0:1789185748.305019:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 45 00000100:00100000:3.0:1789185748.305198:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f77e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879492352:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789185748.305680:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185748.306672:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f77e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879492352:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 1629us (1994us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789185748.306689:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 45 00000100:00100000:1.0:1789185748.310080:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.310253:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879492608 00000100:00100000:0.0:1789185748.310267:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879492608 00000100:00100000:0.0:1789185748.310348:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 30 00000100:00100000:0.0:1789185748.310362:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+66:11397:x1876096879492608:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789185748.310767:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+67:11397:x1876096879492608:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 405us (700us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789185748.310776:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 30 00000100:00100000:0.0:1789185748.314463:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.314699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879492864 00000100:00100000:1.0:1789185748.314716:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879492864 00000100:00100000:1.0:1789185748.314983:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 133 00000100:00100000:1.0:1789185748.314996:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+67:11397:x1876096879492864:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789185748.315475:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+67:11397:x1876096879492864:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 480us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.315485:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 133 00000100:00100000:2.0:1789185748.318562:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.318771:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879492992 00000100:00100000:0.0:1789185748.318789:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879492992 00000100:00100000:0.0:1789185748.319161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 134 00000100:00100000:0.0:1789185748.319176:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+67:11397:x1876096879492992:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185748.319205:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185748.319233:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a736c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f91 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.319330:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a736ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.319349:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a736ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.319365:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a736ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185748.319427:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185748.319453:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a736ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.319486:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a736c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f91 expref: 69 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.319511:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a736ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f91 expref: 68 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.319541:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:0.0:1789185748.319545:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789185748.319550:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db800, rc 0) 00000100:00100000:0.0:1789185748.320366:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+68:11397:x1876096879492992:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 1188us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185748.320377:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 134 00000100:00100000:0.0:1789185748.323620:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.323821:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879493120 00000100:00100000:3.0:1789185748.323835:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879493120 00000100:00100000:3.0:1789185748.324016:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 46 00000100:00100000:3.0:1789185748.324029:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2389:x1876096879493120:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185748.324222:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185748.324404:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f98 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185748.324450:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4ced4, blocks: 0x0 00010000:00010000:2.0:1789185748.324490:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1789185748.324497:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185748.324716:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f98 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.324747:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f98 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.324804:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f600, rc 0) 00000100:00100000:2.0:1789185748.324902:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2389:x1876096879493120:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 874us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.324944:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 46 00000100:00100000:2.0:1789185748.328788:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.329208:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879493376 00000100:00100000:3.0:1789185748.329223:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879493376 00000100:00100000:3.0:1789185748.329313:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 135 00000100:00100000:3.0:1789185748.329325:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+68:11397:x1876096879493376:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789185748.329540:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+68:11397:x1876096879493376:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 216us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.329550:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 135 00000100:00100000:0.0:1789185748.335081:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.335136:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.335357:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879493632 00000100:00100000:2.0:1789185748.335372:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879493632 00000100:00100000:2.0:1789185748.335469:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 320 00000100:00100000:2.0:1789185748.335483:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879493632:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185748.335596:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879493632:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 117us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.335605:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 320 00000100:00080000:0.0:1789185748.336151:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185748.336507:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879493504 00000100:00100000:3.0:1789185748.336525:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879493504 00000100:00100000:3.0:1789185748.336602:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 388 00000100:00100000:3.0:1789185748.336613:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879493504:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185748.336674:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879493504:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 64us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.336682:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 388 00000100:00100000:1.0:1789185748.337105:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.337192:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.339706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.340038:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879493760 00000100:00100000:3.0:1789185748.340050:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879493760 00000100:00100000:3.0:1789185748.340150:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 125 00000100:00100000:3.0:1789185748.340163:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879493760:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185748.340572:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879493760:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 410us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.340582:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 125 00000100:00100000:2.0:1789185748.341223:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879493888 00000100:00100000:2.0:1789185748.341233:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879493888 00000100:00100000:2.0:1789185748.341338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879494016 00000100:00100000:2.0:1789185748.341342:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879494016 00000100:00100000:2.0:1789185748.341367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 321 00000100:00100000:2.0:1789185748.341381:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 322 00000100:00100000:2.0:1789185748.341388:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879494016:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185748.341449:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879494016:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 62us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.341457:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 322 00000100:00100000:2.0:1789185748.341480:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879493888:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185748.341504:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879493888:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 129us (4401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.341542:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 321 00000100:00080000:0.0:1789185748.342085:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185748.342091:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185748.346480:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.347213:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879494144 00000100:00100000:0.0:1789185748.347231:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879494144 00000100:00100000:0.0:1789185748.347421:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 47 00000100:00100000:0.0:1789185748.347434:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+10:11397:x1876096879494144:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185748.347461:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185748.347490:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51f9f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.347610:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f98 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.347624:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185748.347629:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185748.347636:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.347704:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f98 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.347723:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f98 expref: 11 pid: 8430 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185748.347742:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876096898444800:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185748.347886:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789185748.352440:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876096898444800:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185748.352493:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.352534:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021da000, rc 0) 00000100:00100000:1.0:1789185748.352615:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+11:11397:x1876096879494144:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 5182us (6150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.352626:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 47 00000100:00100000:1.0:1789185748.356269:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.356454:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879494272 00000100:00100000:2.0:1789185748.356473:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879494272 00010000:00010000:2.0:1789185748.356558:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f98 expref: 11 pid: 8430 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.356620:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 72 00000100:00100000:2.0:1789185748.356633:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+11:2392:x1876096879494272:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185748.356660:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185748.356699:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f98 expref: 11 pid: 8430 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.356720:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f98 expref: 11 pid: 8430 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.356755:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f98 expref: 11 pid: 8430 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.356779:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185748.356784:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185748.356797:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.356808:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.357256:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.357277:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1876096898444928:192.168.204.48@tcp:105: 00000100:00100000:2.0:1789185748.357383:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789185748.363610:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1876096898444928:192.168.204.48@tcp:105: 00010000:00010000:2.0:1789185748.363657:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185748.363750:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2392:x1876096879494272:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 7118us (7510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.363766:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 72 00000100:00100000:0.0:1789185748.371335:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.371511:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879494400 00000100:00100000:2.0:1789185748.371538:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879494400 00002000:00100000:2.0:1789185748.371617:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff98f1c33f9c00 x1876096879494400/t0(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:349/0 lens 504/0 e 0 to 0 dl 1789185759 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185748.371631:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c33f9c00 with x1876096879494400 ext(0->12) 00002000:00010000:2.0:1789185748.371639:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c33f9c00 00000100:00100000:2.0:1789185748.371688:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:2.0:1789185748.371701:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2392:x1876096879494400:12345-192.168.204.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789185748.374740:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+12:2392:x1876096879494400:12345-192.168.204.48@tcp:4:lhsmtool_posix.0 Request processed in 3022us (3403us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789185748.374762:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 2 00002000:00100000:2.0:1789185748.374782:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff98f1c33f9c00 x1876096879494400/t4294967309(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:349/0 lens 504/448 e 0 to 0 dl 1789185759 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185748.374822:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c33f9c00 with x1876096879494400 ext(0->12) 00002000:00010000:2.0:1789185748.374830:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c33f9c00 00000100:00100000:1.0:1789185748.379446:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.379610:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879494528 00000100:00100000:2.0:1789185748.379626:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879494528 00000100:00100000:2.0:1789185748.379753:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 136 00000100:00100000:2.0:1789185748.379767:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+68:11397:x1876096879494528:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789185748.387426:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1789185748.387448:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:3.0:1789185748.387553:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185748.387556:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:3.0:1789185748.387577:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387589:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387596:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9600 already unused, calling callback (ffffffffc192c4f0) 00000020:00080000:1.0:1789185748.387598:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f2e7b483c0 refcount 2 committed 0 result 0 batchid 3 00010000:00010000:3.0:1789185748.387603:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789185748.387608:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f2d2802e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f2e7b48e40 00000020:00080000:1.0:1789185748.387620:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f1c10fff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f1c19a4800 00010000:00010000:3.0:1789185748.387621:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387648:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:3.0:1789185748.387653:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185748.387659:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387667:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9600/0xda5c730d5a733dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185748.387668:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:3.0:1789185748.387757:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387764:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387771:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387777:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402ec00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.387782:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387789:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387800:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f300ff3d00) 00010000:00010000:3.0:1789185748.387805:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185748.387810:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387818:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73485 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387840:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.387864:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898445056:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789185748.387866:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387884:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.387899:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.387903:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.387991:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185748.388188:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388199:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f2d703d300) 00010000:00010000:3.0:1789185748.388202:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185748.388206:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388214:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73503 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388230:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388238:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388254:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388259:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.388262:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388269:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388290:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f2d703d300) 00010000:00010000:3.0:1789185748.388293:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185748.388296:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388303:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a73526 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388321:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388328:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388335:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388340:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.388343:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388349:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388357:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.388359:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185748.388363:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388369:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a735f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388390:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388397:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388404:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388409:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402ee00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.388412:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388419:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388427:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:3.0:1789185748.388430:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789185748.388434:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.388439:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a736b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789185748.388461:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789185748.388486:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898445056 00000100:00100000:3.0:1789185748.388497:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898445056 00000100:00100000:3.0:1789185748.388889:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789185748.388901:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f278c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3638:x1876096898445056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789185748.388980:0:9819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1789185748.389049:0:9819:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4ced3, atime: 0x6aa4ced3, ctime: 0x6aa4ced3, blocks: 0x8 00010000:00010000:3.0:1789185748.389127:0:9819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.389148:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1789185748.389154:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185748.389163:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.389181:0:9819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.389190:0:9819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.389198:0:9819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.389222:0:9819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789185748.389531:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f278c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3638:x1876096898445056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 630us (1538us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789185748.389540:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1789185748.391735:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185748.391755:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.391773:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185748.391805:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.391819:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.391861:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.391869:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4f72f24/0xda5c730d5a736df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.391997:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185748.391999:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185748.392001:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185748.392783:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898445184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185748.392895:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185748.393379:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898445184 00000100:00100000:3.0:1789185748.393395:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898445184 00000100:00100000:3.0:1789185748.393481:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789185748.393494:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898445184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789185748.393527:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185748.393711:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898445440:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.393761:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.393785:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898445952:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.393807:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185748.394377:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898445184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 881us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.394389:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1789185748.394428:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185748.395885:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898446464:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.398663:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.398741:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789185748.398754:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898445568:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.398790:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.398815:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898446080:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.398838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.398870:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898446592:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.398926:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.398977:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898445440 00000100:00100000:2.0:1789185748.398986:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898445440 00000100:00100000:2.0:1789185748.399036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898445952 00000100:00100000:2.0:1789185748.399041:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898445952 00000100:00100000:2.0:1789185748.399064:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898446464 00000100:00100000:2.0:1789185748.399067:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898446464 00000100:00100000:2.0:1789185748.399079:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898446080 00000100:00100000:2.0:1789185748.399081:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898446080 00000100:00100000:2.0:1789185748.399092:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898446592 00000100:00100000:2.0:1789185748.399094:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898446592 00000100:00100000:2.0:1789185748.399109:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789185748.399118:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898445440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399177:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898445440:12345-0@lo:400:kworker.0 Request processed in 59us (5416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.399184:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789185748.399202:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789185748.399208:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898445952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399234:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f748b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898445952:12345-0@lo:400:kworker.0 Request processed in 27us (5427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.399240:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789185748.399250:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789185748.399255:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898446464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399280:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898446464:12345-0@lo:400:kworker.0 Request processed in 25us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.399285:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789185748.399297:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789185748.399303:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898446080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399328:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898446080:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.399341:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789185748.399354:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789185748.399359:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898446592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399387:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898446592:12345-0@lo:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.399392:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789185748.399416:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898445696:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399440:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.399458:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898446208:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399482:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.399528:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898445184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185748.399546:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789185748.399552:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898445312:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399577:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.399601:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898445824:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399623:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.399643:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898446336:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399667:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.399695:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898445312 00000100:00100000:2.0:1789185748.399700:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898445312 00000100:00100000:2.0:1789185748.399728:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789185748.399734:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898445312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399768:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c6f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898445312:12345-0@lo:400:kworker.0 Request processed in 34us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.399786:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789185748.399816:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898445568 00000100:00100000:2.0:1789185748.399820:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898445568 00000100:00100000:2.0:1789185748.399843:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898445824 00000100:00100000:2.0:1789185748.399859:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898445824 00000100:00100000:2.0:1789185748.399874:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789185748.399880:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898445568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399940:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898445568:12345-0@lo:400:kworker.0 Request processed in 60us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.399947:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789185748.399958:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789185748.399964:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898445824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.399989:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898445824:12345-0@lo:400:kworker.0 Request processed in 26us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.399994:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789185748.400014:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898446208 00000100:00100000:2.0:1789185748.400017:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898446208 00000100:00100000:2.0:1789185748.400042:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898446336 00000100:00100000:2.0:1789185748.400045:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898446336 00000100:00100000:2.0:1789185748.400060:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789185748.400066:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898446208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400095:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898446208:12345-0@lo:400:kworker.0 Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.400101:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789185748.400112:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789185748.400118:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898446336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400156:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898446336:12345-0@lo:400:kworker.0 Request processed in 38us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.400162:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789185748.400183:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898445696 00000100:00100000:2.0:1789185748.400187:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898445696 00000100:00100000:2.0:1789185748.400204:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789185748.400209:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898445696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400238:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898445696:12345-0@lo:400:kworker.0 Request processed in 28us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.400243:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789185748.400264:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898445312:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400273:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898445824:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400282:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898446336:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400291:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898445696:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400300:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898446208:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400332:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898445568:0@lo:400:kworker.0 00010000:00080000:2.0:1789185748.400346:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300ed7100 x1876096898446080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185748.400357:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898446080:0@lo:400:kworker.0 00010000:00080000:2.0:1789185748.400368:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f300ed6d80 x1876096898446592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185748.400377:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898446592:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400397:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898445440:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400407:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898445952:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.400416:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898446464:0@lo:400:kworker.0 00000100:00100000:2.0:1789185748.402785:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898446720:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789185748.402870:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185748.403215:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898446848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789185748.403326:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898446720 00000100:00100000:2.0:1789185748.403336:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898446720 00000100:00100000:2.0:1789185748.403384:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789185748.403394:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898446720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789185748.403426:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1789185748.403468:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.403492:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef7 expref: 11 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.403502:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789185748.403507:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185748.403513:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.403546:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef7 expref: 11 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.403563:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef7 expref: 11 pid: 9819 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.403592:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876096898447104:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185748.403680:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898446976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185748.406357:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789185748.406431:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789185748.406453:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185748.406456:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789185748.406512:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f1c3485880/2, rc 0, transno 4294967305 00000100:00100000:3.0:1789185748.406522:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898445056:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789185748.407363:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898446848 00000100:00100000:3.0:1789185748.407374:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898446848 00000100:00100000:3.0:1789185748.407413:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789185748.407422:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3636:x1876096898446848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789185748.407557:0:9819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789185748.407561:0:9819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789185748 00002000:00010000:3.0:1789185748.407563:0:9819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789185748.407566:0:9819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789185748 -> 1789185748 00002000:00010000:3.0:1789185748.407568:0:9819:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789185748.407811:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3636:x1876096898446848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 388us (1461us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789185748.407819:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1789185748.407884:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f1c33fa680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789185748.407889:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898446848:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789185748.409823:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789185748.409837:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000020:00080000:1.0:1789185748.411489:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f2e7b48cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789185748.411517:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f2d156b300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f2e7b48540 00000020:00080000:1.0:1789185748.411521:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f2d156bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f2d9951a00 00000020:00080000:1.0:1789185748.411614:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789185748.411701:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789185748.411841:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11397:x1876096879494528:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 Request processed in 32073us (32410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.411865:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 136 00000100:00100000:3.0:1789185748.412555:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ffa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898447232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185748.412612:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.412943:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185748.416000:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898447232 00000100:00100000:1.0:1789185748.416025:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898447232 00000100:00100000:1.0:1789185748.416116:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789185748.416126:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898447232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185748.416166:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789185748.416265:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898447232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (3653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.416272:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789185748.417062:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ffa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898447232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185748.417303:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.417517:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876096898447104:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185748.417542:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.418172:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879494656 00000100:00100000:3.0:1789185748.418181:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879494656 00000100:00100000:3.0:1789185748.418232:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:3.0:1789185748.418240:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+12:2391:x1876096879494656:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789185748.419032:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.419200:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898446976 00000100:00100000:2.0:1789185748.419207:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898446976 00000100:00100000:2.0:1789185748.419249:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789185748.419258:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898446976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185748.419279:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1789185748.419342:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898446976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.419349:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789185748.419953:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789185748.419962:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1789185748.419982:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f2ffa82300, transno 4294967302 00000004:00080000:1.0:1789185748.419995:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1789185748.420009:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f1c3485880, transno 4294967305 00000100:00100000:1.0:1789185748.420236:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898446976:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789185748.420885:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1789185748.420896:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1789185748.421191:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879494656:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 Request processed in 2946us (3885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.421201:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:3.0:1789185748.422237:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.422405:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879494784 00000100:00100000:0.0:1789185748.422416:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879494784 00010000:00010000:0.0:1789185748.422461:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef7 expref: 7 pid: 9819 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185748.422509:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 73 00000100:00100000:0.0:1789185748.422519:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879494784:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185748.422536:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185748.422543:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef7 expref: 7 pid: 9819 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.422577:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef7 expref: 7 pid: 9819 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.422606:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a73493 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ef7 expref: 7 pid: 9819 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.422623:0:10394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185748.422627:0:10394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185748.422633:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.422661:0:10394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.422695:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185748.422751:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879494784:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 232us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185748.422758:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 73 00010000:00010000:2.0:1789185748.422978:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.422989:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.423000:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.423009:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.423035:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789185748.423218:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898446720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19824us (20347us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789185748.423225:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789185748.423320:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185748.423327:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.423336:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185748.423340:0:9518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.423362:0:9518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.423377:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.423383:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e2fa242/0xda5c730d5a736e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.423400:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185748.423402:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185748.423404:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185748.424536:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789185748.424551:0:3635:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1789185748.424577:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f1c33fa680, transno 4294967310 00000100:00100000:3.0:1789185748.424607:0:3635:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98f1c33fa300 x1876096898446720/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789185764 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789185748.424620:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f1c33fa300/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789185748.424626:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898446720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789185748.427416:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.427494:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879495040 00000100:00100000:2.0:1789185748.427506:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879495040 00000100:00100000:2.0:1789185748.427578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 137 00000100:00100000:2.0:1789185748.427590:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11397:x1876096879495040:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185748.427862:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185748.427896:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a736ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f91 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.428000:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:2.0:1789185748.428007:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185748.428047:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.428064:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.428074:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185748.428194:0:6513:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c5cfc53a reply state 00000000341bf705 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.428206:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.428219:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:2.0:1789185748.428221:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185748.428224:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185748.429513:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11397:x1876096879495040:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 1917us (2097us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789185748.429525:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 137 00000100:00100000:1.0:1789185748.438198:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.438279:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879495168 00000100:00100000:2.0:1789185748.438290:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879495168 00000100:00100000:2.0:1789185748.438346:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:2.0:1789185748.438357:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879495168:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789185748.438533:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789185748.438537:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789185748 -> 1789185747 00002000:00010000:2.0:1789185748.438540:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789185747 00002000:00010000:2.0:1789185748.438543:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789185748 -> 1789185747 00002000:00010000:2.0:1789185748.438545:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789185748.438615:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879495168:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 258us (426us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789185748.438623:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:1.0:1789185748.444035:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.444513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879495424 00000100:00100000:0.0:1789185748.444526:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879495424 00000100:00100000:0.0:1789185748.444594:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 138 00000100:00100000:0.0:1789185748.444605:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+17:11397:x1876096879495424:12345-192.168.204.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789185748.444679:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.444697:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f83 expref: 17 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.444709:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.444744:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f83 expref: 17 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.444777:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f83 expref: 17 pid: 9473 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185748.444792:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898447360:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185748.444887:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185748.463746:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.463865:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879495552 00000100:00100000:3.0:1789185748.463875:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879495552 00010000:00010000:3.0:1789185748.463960:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f83 expref: 18 pid: 9473 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.464012:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 74 00000100:00100000:3.0:1789185748.464033:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:2391:x1876096879495552:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185748.464050:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185748.464057:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f83 expref: 18 pid: 9473 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.464073:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f83 expref: 18 pid: 9473 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.464096:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:3.0:1789185748.464110:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.464120:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.464128:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.464150:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185748.464216:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:2391:x1876096879495552:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 194us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.464225:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 74 00010000:00010000:2.0:1789185748.467110:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a736ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f83 expref: 17 pid: 9473 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.467140:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898447360:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185748.467166:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.467177:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.467203:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.467244:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.467252:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.467259:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.467265:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185748.467270:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.467278:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.467295:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:2.0:1789185748.467298:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789185748.467302:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.467308:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a736f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.467453:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11397:x1876096879495424:12345-192.168.204.48@tcp:55:lhsmtool_posix.0 Request processed in 22848us (23438us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789185748.467463:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 138 00000100:00100000:1.0:1789185748.476707:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.477129:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879495680 00000100:00100000:3.0:1789185748.477140:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879495680 00000100:00100000:3.0:1789185748.477199:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 53 00000100:00100000:3.0:1789185748.477209:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2389:x1876096879495680:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789185748.477255:0:9819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.477278:0:9819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.477289:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185748.477294:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185748.477299:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.478155:0:9819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.478186:0:9819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 7 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.478203:0:9819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9819:1876096898447488:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185748.478356:0:9819:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185748.493588:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.493702:0:9819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9819:1876096898447488:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185748.493731:0:9819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185748.493903:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879495808 00000100:00100000:1.0:1789185748.493952:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879495808 00010000:00010000:1.0:1789185748.493994:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 8 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185748.494038:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 75 00000100:00100000:1.0:1789185748.494050:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879495808:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185748.494069:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185748.494096:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 8 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.494109:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 8 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.494133:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a736d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f9f expref: 8 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.494152:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185748.494156:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185748.494161:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.494170:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.494194:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185748.494278:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879495808:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 229us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.494285:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 75 00010000:00010000:3.0:1789185748.494642:0:9819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.494653:0:9819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.494675:0:9819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.494684:0:9819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.494692:0:9819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.494715:0:9819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185748.494722:0:9819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.494731:0:9819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.494757:0:9819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.494765:0:9819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a736fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.494826:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879495680:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 Request processed in 17618us (18130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.494836:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 53 00000100:00100000:0.0:1789185748.500038:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185748.500209:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879496064 00000100:00100000:1.0:1789185748.500219:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879496064 00000100:00100000:1.0:1789185748.500272:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 139 00000100:00100000:1.0:1789185748.500283:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+16:11397:x1876096879496064:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789185748.500366:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.500385:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f4b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.500395:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.500431:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f4b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.500446:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f4b expref: 16 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185748.500461:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898447616:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185748.500551:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185748.506571:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.506684:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898447616:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185748.506712:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.506841:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879496192 00000100:00100000:3.0:1789185748.506860:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879496192 00010000:00010000:3.0:1789185748.506896:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f4b expref: 17 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.506963:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 76 00000100:00100000:3.0:1789185748.506973:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+17:2391:x1876096879496192:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185748.506993:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185748.507000:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f4b expref: 17 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.507039:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f4b expref: 17 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.507061:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a735f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f4b expref: 17 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.507075:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.507081:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f6e expref: 16 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.507091:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.507098:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.507106:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.507134:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185748.507182:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+16:2391:x1876096879496192:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 210us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.507190:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 76 00010000:00010000:1.0:1789185748.507505:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.507515:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.508133:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.508149:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f8a expref: 16 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.508156:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.508189:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f8a expref: 16 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.508204:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f8a expref: 16 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185748.508217:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898447744:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185748.508359:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b486c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185748.527262:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185748.527366:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879496320 00000100:00100000:0.0:1789185748.527377:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879496320 00010000:00010000:0.0:1789185748.527422:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f8a expref: 17 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185748.527471:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 77 00000100:00100000:0.0:1789185748.527484:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+17:2392:x1876096879496320:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185748.527503:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185748.527510:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f8a expref: 17 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.527524:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f8a expref: 17 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.527552:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:0.0:1789185748.527558:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.527570:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.527596:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.527619:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185748.527690:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+17:2392:x1876096879496320:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 209us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185748.527698:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 77 00010000:00010000:2.0:1789185748.528215:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a736bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f8a expref: 16 pid: 8147 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.528237:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898447744:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185748.528261:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.528271:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.528277:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185748.528413:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1789185748.528538:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789185748.528576:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789185748.528663:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898447872:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789185748.528722:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185748.528901:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf2480 going to sleep for 11 seconds 00000100:00100000:0.0:1789185748.546102:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898447872 00000100:00100000:0.0:1789185748.546119:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898447872 00000100:00100000:0.0:1789185748.546181:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789185748.546191:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9473:x1876096898447872:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789185748.546340:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9473:x1876096898447872:12345-0@lo:1000:mdt00_004.0 Request processed in 150us (17617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185748.546348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789185748.546738:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898447872:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1789185748.547001:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1789185748.547096:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898448000:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789185748.547145:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185748.547201:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c10e9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185748.547709:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898448000 00000100:00100000:0.0:1789185748.547717:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898448000 00000100:00100000:0.0:1789185748.547786:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789185748.547797:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9473:x1876096898448000:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789185748.548006:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9473:x1876096898448000:12345-0@lo:1000:mdt00_004.0 Request processed in 210us (859us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789185748.548015:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789185748.548043:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898448000:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1789185748.548091:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548101:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548110:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548116:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0a00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.548121:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548129:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548145:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:3.0:1789185748.548148:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185748.548154:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548160:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73709 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548184:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548191:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548197:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548212:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.548217:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548222:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548232:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.548234:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185748.548242:0:9473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f6e expref: 19 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548253:0:9473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f6e expref: 19 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548263:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f6e expref: 19 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.548293:0:9473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f6e expref: 19 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.548307:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898448128:192.168.204.48@tcp:105: 00000100:00100000:3.0:1789185748.548383:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185748.557679:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898448128:192.168.204.48@tcp:105: 00010000:00010000:3.0:1789185748.557714:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557726:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a7364c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557773:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557787:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557797:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557810:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557817:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557824:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557829:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.557833:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557840:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557863:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.557866:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185748.557869:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557875:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73710 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557893:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557899:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557905:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557951:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1a00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185748.557954:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557960:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557968:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.557970:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185748.557973:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.557979:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73702 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.558136:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+19:11397:x1876096879496064:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 57855us (58119us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789185748.558146:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 139 00000020:00080000:3.0:1789185748.558153:0:9473:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789185748.560034:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185748.560045:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185748.560547:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789185748.560561:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789185748.573049:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.573158:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879496576 00000100:00100000:2.0:1789185748.573169:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879496576 00000100:00100000:2.0:1789185748.573233:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:2.0:1789185748.573261:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+19:11397:x1876096879496576:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789185748.577008:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789185748.577060:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789185748.577142:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.577160:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.577172:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.577182:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.577189:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.577197:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.577229:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789185748.577356:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:11397:x1876096879496576:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 4094us (4314us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789185748.577367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 31 00000020:00080000:3.0:1789185748.577373:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789185748.577647:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185748.577655:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.577663:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185748.577675:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.577683:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.577697:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:0.0:1789185748.577700:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789185748.577704:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.577710:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a73717 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185748.577726:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185748.577728:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185748.577729:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185748.591611:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.592237:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879496704 00000100:00100000:2.0:1789185748.592250:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879496704 00000100:00100000:2.0:1789185748.592314:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 32 00000100:00100000:2.0:1789185748.592325:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6595c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+21:11396:x1876096879496704:12345-192.168.204.48@tcp:49:lfs.0 00000100:00100000:2.0:1789185748.592454:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6595c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+21:11396:x1876096879496704:12345-192.168.204.48@tcp:49:lfs.0 Request processed in 130us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.592461:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 32 00000100:00100000:1.0:1789185748.640996:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.641171:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879496960 00000100:00100000:2.0:1789185748.641182:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879496960 00000100:00100000:2.0:1789185748.641249:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 140 00000100:00100000:2.0:1789185748.641260:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:11396:x1876096879496960:12345-192.168.204.48@tcp:58:lfs.0 00000040:00080000:2.0:1789185748.641449:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789185748.641577:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:11396:x1876096879496960:12345-192.168.204.48@tcp:58:lfs.0 Request processed in 317us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185748.641585:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 140 00000100:00100000:0.0:1789185748.702432:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.702541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879497088 00000100:00100000:2.0:1789185748.702552:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879497088 00000100:00100000:2.0:1789185748.702612:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 141 00000100:00100000:2.0:1789185748.702623:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+21:11399:x1876096879497088:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185748.702648:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185748.702670:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7371e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fa6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.702743:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.702772:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.702784:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.702801:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.702808:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.702816:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.702961:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.702974:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f67 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.702982:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.703020:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f67 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185748.703034:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f67 expref: 22 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185748.703060:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898448256:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185748.703262:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f27893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185748.708776:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876096898448256:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185748.708810:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185748.710209:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185748.710451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879497344 00000100:00100000:2.0:1789185748.710459:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879497344 00000100:00100000:2.0:1789185748.710564:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:2.0:1789185748.710577:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+23:6161:x1876096879497344:12345-192.168.204.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789185748.710847:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+24:6161:x1876096879497344:12345-192.168.204.48@tcp:35:ldlm_bl.0 Request processed in 263us (635us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789185748.710864:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:1.0:1789185748.715962:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185748.716095:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879497472 00000100:00100000:3.0:1789185748.716107:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879497472 00010000:00010000:3.0:1789185748.716156:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f67 expref: 24 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185748.716211:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 78 00000100:00100000:3.0:1789185748.716221:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+24:2392:x1876096879497472:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185748.716237:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185748.716271:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f67 expref: 24 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.716285:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f67 expref: 24 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.716309:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a7363e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f67 expref: 24 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.716326:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:3.0:1789185748.716332:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.716343:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.716351:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185748.716384:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185748.716437:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+23:2392:x1876096879497472:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 217us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185748.716445:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 78 00010000:00010000:1.0:1789185748.716713:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.716722:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185748.716785:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789185748.716797:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185748.716822:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.716836:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717336:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717344:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717351:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717358:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185748.717364:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717373:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717387:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:1.0:1789185748.717390:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185748.717394:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717401:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73725 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717415:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717436:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717443:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717448:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185748.717451:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717456:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717465:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f2fae07600) 00010000:00010000:1.0:1789185748.717468:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185748.717471:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717477:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a7372c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.717988:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7371e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fa6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.718009:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fa6 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185748.718018:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:1.0:1789185748.718021:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185748.718032:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402fe00, rc 0) 00000100:00100000:1.0:1789185748.718092:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11399:x1876096879497088:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 15470us (15670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185748.718102:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 141 00010000:00010000:2.0:1789185749.286204:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185749.519305:0:14271:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789185749.519315:0:14271:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185749.519346:0:14271:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789185749.519354:0:14271:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789185749.609183:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789185749.609194:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185749.609242:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789185749.609252:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789185749.609409:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898448384:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789185749.609533:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48840 going to sleep for 11 seconds 00000100:00100000:2.0:1789185749.615657:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185749.615690:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879497600 00000100:00100000:2.0:1789185749.615700:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879497600 00000100:00100000:2.0:1789185749.615759:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 142 00000100:00100000:2.0:1789185749.615769:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+23:11411:x1876096879497600:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789185749.615813:0:9473:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185749.615889:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898448384:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185749.615985:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11411:x1876096879497600:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 216us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185749.615992:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 142 00000100:00100000:1.0:1789185749.631545:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185749.631592:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879497856 00000100:00100000:1.0:1789185749.631603:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879497856 00000100:00100000:1.0:1789185749.631668:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 143 00000100:00100000:1.0:1789185749.631680:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+22:11411:x1876096879497856:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185749.631710:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185749.631739:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7373a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fad expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.631874:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73741 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.631892:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.631942:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185749.631957:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789185749.632093:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7373a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fad expref: 25 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.632115:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fad expref: 24 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.632124:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:1.0:1789185749.632127:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185749.632132:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1400, rc 0) 00000100:00100000:1.0:1789185749.632217:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+24:11411:x1876096879497856:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 538us (683us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789185749.632225:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 143 00000100:00100000:0.0:1789185749.642311:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185749.642347:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185749.642388:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879498240 00000100:00100000:0.0:1789185749.642399:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879498240 00000100:00100000:0.0:1789185749.642476:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:0.0:1789185749.642489:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+24:2391:x1876096879498240:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185749.642506:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185749.642537:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73741 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fad expref: 24 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185749.642555:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:0.0:1789185749.642569:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185749.642628:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+23:2391:x1876096879498240:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 142us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185749.642636:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:1.0:1789185749.642653:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879498112 00000100:00100000:1.0:1789185749.642657:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879498112 00000100:00100000:1.0:1789185749.642714:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 144 00000100:00100000:1.0:1789185749.642722:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+23:11411:x1876096879498112:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789185749.642803:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.642818:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.642840:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.643044:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.643052:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.643060:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.643066:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185749.643071:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.643080:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.643089:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:1.0:1789185749.643092:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185749.643096:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185749.643102:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7374f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185749.643189:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+24:11411:x1876096879498112:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 468us (888us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789185749.643197:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 144 00000040:00080000:1.0:1789185749.643293:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789185749.643298:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185749.644291:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789185749.644315:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789185749.654002:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185749.654088:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879498496 00000100:00100000:0.0:1789185749.654104:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879498496 00000100:00100000:0.0:1789185749.654176:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 34 00000100:00100000:0.0:1789185749.654188:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+24:11411:x1876096879498496:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789185749.654483:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+25:11411:x1876096879498496:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 296us (493us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789185749.654493:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 34 00000100:00100000:0.0:1789185749.926286:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185749.926325:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898448512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185749.926424:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185749.926571:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898448512 00000100:00100000:1.0:1789185749.926582:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898448512 00000100:00100000:1.0:1789185749.926648:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789185749.926661:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898448512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185749.926704:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185749.926761:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898448512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185749.926769:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789185749.926968:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898448512:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185750.310870:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185750.951118:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898448640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185750.951214:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185750.951339:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898448640 00000100:00100000:2.0:1789185750.951348:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898448640 00000100:00100000:1.0:1789185750.951543:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789185750.951560:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898448640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185750.951604:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789185750.951693:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898448640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185750.951701:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789185750.951767:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898448640:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789185750.951889:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185750.952373:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185750.957081:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898448768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185750.957205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185750.957434:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898448768 00000100:00100000:2.0:1789185750.957446:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898448768 00000100:00100000:2.0:1789185750.957530:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789185750.957541:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898448768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185750.957574:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789185750.957635:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898448768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185750.957642:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789185750.957703:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898448768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789185750.957770:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185751.334546:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789185751.538411:0:14322:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185751.546124:0:14322:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185751.546215:0:14322:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789185751.546225:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789185751.715570:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185751.715658:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879498752 00000100:00100000:2.0:1789185751.715673:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879498752 00000100:00100000:2.0:1789185751.715826:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 145 00000100:00100000:2.0:1789185751.715840:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+25:11431:x1876096879498752:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185751.715874:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185751.715902:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73756 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fb4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.716087:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7375d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.716106:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7375d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.716120:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7375d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185751.716134:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789185751.716281:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73756 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fb4 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.716299:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7375d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fb4 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.716309:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:2.0:1789185751.716312:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789185751.716318:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e200, rc 0) 00000100:00100000:2.0:1789185751.716399:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+27:11431:x1876096879498752:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 562us (887us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789185751.716408:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 145 00000100:00080000:0.0:1789185751.721496:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185751.723212:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185751.724647:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879498880 00000100:00100000:2.0:1789185751.724671:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879498880 00000100:00100000:2.0:1789185751.724811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 146 00000100:00100000:2.0:1789185751.724826:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+27:11431:x1876096879498880:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:2.0:1789185751.724950:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.724984:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.725000:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.725043:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.725051:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.725058:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.725064:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185751.725069:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.725077:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.725090:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:2.0:1789185751.725093:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185751.725099:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185751.725106:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a7376b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185751.725208:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+27:11431:x1876096879498880:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 385us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185751.725223:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 146 00000100:00100000:2.0:1789185751.827586:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185751.827655:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879499008 00000100:00100000:0.0:1789185751.827671:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879499008 00000100:00100000:0.0:1789185751.827778:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 54 00000100:00100000:0.0:1789185751.827805:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2389:x1876096879499008:12345-192.168.204.48@tcp:101:cat.0 00010000:00010000:0.0:1789185751.827832:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185751.827865:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a73772 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fbb expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789185751.827957:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4ced3, atime: 0x6aa4ced3, ctime: 0x6aa4ced3, blocks: 0x8 00010000:00010000:0.0:1789185751.827990:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789185751.827995:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185751.828007:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a73772 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fbb expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185751.828031:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a73772 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fbb expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185751.828047:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021da000, rc 0) 00000100:00080000:3.0:1789185751.828077:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185751.828127:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2389:x1876096879499008:12345-192.168.204.48@tcp:101:cat.0 Request processed in 326us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185751.828134:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 54 00000100:00100000:0.0:1789185751.834422:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185751.836481:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879499136 00000100:00100000:3.0:1789185751.836527:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879499136 00002000:00100000:2.0:1789185751.836689:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff98f1c3563800 x1876096879499136/t0(0) o3->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:352/0 lens 488/0 e 0 to 0 dl 1789185762 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185751.836703:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c3563800 with x1876096879499136 ext(0->4095) 00002000:00010000:2.0:1789185751.836711:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c3563800 00000100:00100000:2.0:1789185751.836754:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:2.0:1789185751.836766:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2390:x1876096879499136:12345-192.168.204.48@tcp:3:cat.0 00000100:00100000:2.0:1789185751.837084:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2390:x1876096879499136:12345-192.168.204.48@tcp:3:cat.0 Request processed in 319us (2676us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789185751.837092:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 3 00002000:00100000:2.0:1789185751.837100:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff98f1c3563800 x1876096879499136/t0(0) o3->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:352/0 lens 488/4536 e 0 to 0 dl 1789185762 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185751.837108:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c3563800 with x1876096879499136 ext(0->4095) 00002000:00010000:2.0:1789185751.837113:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c3563800 00010000:00010000:0.0:1789185752.358543:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185752.742174:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789185752.742195:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185752.742216:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789185752.742226:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789185752.880514:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789185753.401567:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185753.458349:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185753.458391:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185753.458434:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185753.458461:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185753.458481:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185753.458512:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185753.458535:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185753.458568:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879499264 00000100:00100000:3.0:1789185753.458579:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879499264 00000100:00100000:3.0:1789185753.458638:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 390 00000100:00100000:3.0:1789185753.458648:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879499264:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185753.458725:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879499264:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 79us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185753.458733:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 390 00000100:00100000:3.0:1789185753.458777:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879499776 00000100:00100000:3.0:1789185753.458781:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879499776 00000100:00100000:3.0:1789185753.458815:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879499648 00000100:00100000:3.0:1789185753.458818:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879499648 00000100:00100000:3.0:1789185753.458842:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 128 00000100:00100000:3.0:1789185753.458848:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879499776:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185753.458876:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879499776:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185753.458883:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 128 00000100:00100000:3.0:1789185753.458894:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 129 00000100:00100000:3.0:1789185753.458900:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879499648:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185753.458947:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879499648:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 47us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185753.458969:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 129 00000100:00100000:3.0:1789185753.458988:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879499520 00000100:00100000:3.0:1789185753.458992:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879499520 00000100:00100000:3.0:1789185753.459020:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879500032 00000100:00100000:3.0:1789185753.459023:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879500032 00000100:00100000:3.0:1789185753.459035:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879499392 00000100:00100000:3.0:1789185753.459038:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879499392 00000100:00100000:3.0:1789185753.459050:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879499904 00000100:00100000:3.0:1789185753.459053:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879499904 00000100:00100000:3.0:1789185753.459066:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 329 00000100:00100000:3.0:1789185753.459072:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879499520:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185753.459101:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879499520:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 28us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185753.459107:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 329 00000100:00100000:3.0:1789185753.459119:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 330 00000100:00100000:3.0:1789185753.459125:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879500032:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185753.459147:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879500032:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 23us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185753.459153:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 330 00000100:00100000:3.0:1789185753.459164:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 331 00000100:00100000:3.0:1789185753.459170:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+27:2392:x1876096879499392:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185753.459193:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+27:2392:x1876096879499392:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 23us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185753.459199:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 331 00000100:00100000:3.0:1789185753.459209:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 332 00000100:00100000:3.0:1789185753.459223:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879499904:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185753.459250:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879499904:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 28us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185753.459255:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 332 00000100:00080000:3.0:1789185753.459281:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185753.459286:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185753.459288:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789185753.459290:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185753.510698:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898448896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185753.510784:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.511260:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898449024:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.511299:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.511337:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898449536:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.511363:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.511392:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898450048:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.511427:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.511450:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789185753.511456:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c2301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898449152:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.511480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.511506:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898449664:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.511527:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.511544:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898450176:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.511565:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.511594:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898450048 00000100:00100000:2.0:1789185753.511601:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898450048 00000100:00100000:2.0:1789185753.511658:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789185753.511666:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1876096898450048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.511721:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1876096898450048:12345-0@lo:400:kworker.0 Request processed in 55us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.511728:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789185753.511769:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898449152 00000100:00100000:2.0:1789185753.511774:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898449152 00000100:00100000:2.0:1789185753.511799:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898449664 00000100:00100000:2.0:1789185753.511801:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898449664 00000100:00100000:2.0:1789185753.511822:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898450176 00000100:00100000:2.0:1789185753.511824:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898450176 00000100:00100000:2.0:1789185753.511839:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789185753.511845:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898449152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.511879:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898449152:12345-0@lo:400:kworker.0 Request processed in 34us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.511885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789185753.511939:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789185753.511946:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898449664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.511976:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898449664:12345-0@lo:400:kworker.0 Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.511982:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789185753.511993:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789185753.511999:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898450176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512022:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898450176:12345-0@lo:400:kworker.0 Request processed in 24us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.512028:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:2.0:1789185753.512050:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185753.512054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185753.512074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898449408:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512096:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.512111:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898449920:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512128:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.512144:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898450432:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512161:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.512178:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789185753.512183:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898449280:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512204:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.512221:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898449792:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512241:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.512256:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898450304:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185753.512308:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898449920 00000100:00100000:2.0:1789185753.512312:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898449920 00000100:00100000:2.0:1789185753.512339:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898450432 00000100:00100000:2.0:1789185753.512342:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898450432 00000100:00100000:2.0:1789185753.512361:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789185753.512367:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898449920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512401:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898449920:12345-0@lo:400:kworker.0 Request processed in 34us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.512407:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789185753.512422:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789185753.512427:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898450432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512455:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898450432:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.512461:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789185753.512483:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898449408 00000100:00100000:2.0:1789185753.512486:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898449408 00000100:00100000:2.0:1789185753.512504:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898449792 00000100:00100000:2.0:1789185753.512507:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898449792 00000100:00100000:2.0:1789185753.512523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898450304 00000100:00100000:2.0:1789185753.512525:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898450304 00000100:00100000:2.0:1789185753.512537:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789185753.512543:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898449408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512573:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898449408:12345-0@lo:400:kworker.0 Request processed in 29us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.512578:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789185753.512590:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789185753.512596:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898449792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512621:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898449792:12345-0@lo:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.512635:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789185753.512647:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789185753.512652:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898450304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512680:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898450304:12345-0@lo:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.512685:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:2.0:1789185753.512703:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185753.512706:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185753.512708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185753.512743:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c2301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898449152:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512768:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898449664:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512778:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898450176:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512788:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898450048:0@lo:400:kworker.0 00010000:00080000:2.0:1789185753.512825:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33d2300 x1876096898449792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185753.512835:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898449792:0@lo:400:kworker.0 00010000:00080000:2.0:1789185753.512843:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c411c000 x1876096898450304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185753.512850:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898450304:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512859:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898449408:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512867:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898449920:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512874:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898450432:0@lo:400:kworker.0 00000100:00100000:2.0:1789185753.512961:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898448896 00000100:00100000:2.0:1789185753.512966:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898448896 00000100:00100000:2.0:1789185753.512998:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789185753.513004:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898448896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789185753.513030:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185753.514221:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185753.514239:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898450560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185753.514296:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185753.514341:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898449536 00000100:00100000:1.0:1789185753.514347:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898449536 00000100:00100000:1.0:1789185753.514383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898449280 00000100:00100000:1.0:1789185753.514399:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898449280 00000100:00100000:3.0:1789185753.514885:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898450688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185753.514962:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185753.514993:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898450688 00000100:00100000:3.0:1789185753.514997:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898450688 00000100:00100000:3.0:1789185753.515019:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789185753.515026:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898450688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185753.515044:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185753.515079:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898450688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185753.515085:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789185753.515121:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898450688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185753.515184:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898450560 00000100:00100000:1.0:1789185753.515189:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898450560 00000100:00100000:1.0:1789185753.515207:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789185753.515213:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898449536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185753.515249:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898449536:12345-0@lo:400:kworker.0 Request processed in 37us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185753.515254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789185753.515267:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789185753.515273:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1876096898449280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185753.515313:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1876096898449280:12345-0@lo:400:kworker.0 Request processed in 40us (3108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185753.515319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789185753.515332:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789185753.515338:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898450560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185753.515361:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789185753.515393:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898450560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185753.515398:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789185753.515552:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898449024 00000100:00100000:0.0:1789185753.515558:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898449024 00000100:00100000:0.0:1789185753.515587:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1789185753.515595:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898449024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185753.515633:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898449024:12345-0@lo:400:kworker.0 Request processed in 39us (4333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185753.515639:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789185753.516629:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898450560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185753.516669:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898449280:0@lo:400:kworker.0 00000100:00100000:1.0:1789185753.516764:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898449024:0@lo:400:kworker.0 00000100:00100000:1.0:1789185753.516779:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898449536:0@lo:400:kworker.0 00000100:00080000:3.0:1789185753.517994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185753.518090:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898448896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5081us (7302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185753.518101:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789185753.518891:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898448896:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1789185754.029385:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789185754.029421:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f2c7f15cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789185754.029426:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f1c3716500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f2c7f153c0 00000020:00080000:1.0:1789185754.029430:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f1c3716c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f2d8b52000 00000020:00080000:3.0:1789185754.030279:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1789185754.030361:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1789185754.030386:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185754.030401:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185754.030409:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185754.030415:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185754.030420:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185754.030427:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185754.030450:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f2d703d400) 00010000:00010000:2.0:1789185754.030453:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185754.030458:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185754.030464:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a736ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789185754.030711:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1789185754.031487:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1789185754.031498:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1789185754.408278:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185755.046653:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898450816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185755.047618:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185755.048122:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898450816 00000100:00100000:1.0:1789185755.048132:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898450816 00000100:00100000:1.0:1789185755.048186:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789185755.048197:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898450816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185755.048239:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185755.048314:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898450816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185755.048322:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789185755.048422:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898450816:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789185755.430143:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185756.071769:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185756.071792:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898450944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185756.071859:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185756.071950:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898450944 00000100:00100000:3.0:1789185756.071958:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898450944 00000100:00100000:3.0:1789185756.072012:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789185756.072022:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898450944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789185756.072054:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789185756.072099:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898450944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185756.072106:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1789185756.072139:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185756.072176:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898450944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185756.074530:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898451072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185756.074601:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185756.075243:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898451072 00000100:00100000:0.0:1789185756.075255:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898451072 00000100:00100000:0.0:1789185756.075327:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789185756.075337:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898451072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185756.075361:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789185756.075413:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898451072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185756.075420:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789185756.075488:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185756.075521:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1789185756.075527:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f1c33fa300, transno 4294967311 00000004:00080000:1.0:1789185756.075545:0:3635:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1789185756.075580:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898451072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789185756.455036:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185757.327447:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185757.327590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879500160 00000100:00100000:0.0:1789185757.327600:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879500160 00000100:00080000:1.0:1789185757.327788:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185757.327857:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 147 00000100:00100000:2.0:1789185757.327871:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+13:11084:x1876096879500160:12345-192.168.204.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789185757.328040:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+13:11084:x1876096879500160:12345-192.168.204.48@tcp:60:lhsmtool_posix.0 Request processed in 173us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185757.328048:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 147 00000100:00100000:0.0:1789185757.335877:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185757.336090:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879500288 00000100:00100000:2.0:1789185757.336100:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879500288 00000100:00100000:2.0:1789185757.336186:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 148 00000100:00100000:2.0:1789185757.336197:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:11084:x1876096879500288:12345-192.168.204.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789185757.336319:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:11084:x1876096879500288:12345-192.168.204.48@tcp:60:lhsmtool_posix.0 Request processed in 124us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185757.336328:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 148 00000100:00080000:1.0:1789185757.336451:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185757.343332:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185757.343420:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879500544 00000100:00100000:1.0:1789185757.343438:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879500544 00000100:00100000:1.0:1789185757.343515:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 35 00000100:00100000:1.0:1789185757.343530:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+13:11084:x1876096879500544:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789185757.343818:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+14:11084:x1876096879500544:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 290us (499us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789185757.343826:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 35 00010000:00010000:2.0:1789185757.478224:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185758.502459:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185758.567699:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185758.567743:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185758.567773:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185758.567805:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185758.567824:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185758.567842:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185758.567869:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185758.567895:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879500800 00000100:00100000:0.0:1789185758.567935:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879500800 00000100:00100000:2.0:1789185758.568073:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879500928 00000100:00100000:2.0:1789185758.568078:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879500928 00000100:00100000:2.0:1789185758.568123:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879501312 00000100:00100000:2.0:1789185758.568140:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879501312 00000100:00100000:2.0:1789185758.568165:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879501440 00000100:00100000:2.0:1789185758.568168:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879501440 00000100:00100000:2.0:1789185758.568186:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 339 00000100:00100000:2.0:1789185758.568196:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879500928:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185758.568285:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879500928:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 90us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.568293:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 339 00000100:00100000:2.0:1789185758.568312:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 340 00000100:00100000:2.0:1789185758.568318:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879501312:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185758.568344:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879501312:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 27us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.568350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 340 00000100:00100000:2.0:1789185758.568362:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 341 00000100:00100000:2.0:1789185758.568369:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879501440:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185758.568393:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879501440:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.568398:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 341 00000100:00100000:2.0:1789185758.568416:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879501056 00000100:00100000:2.0:1789185758.568420:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879501056 00000100:00100000:2.0:1789185758.568446:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879501184 00000100:00100000:2.0:1789185758.568449:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879501184 00000100:00100000:2.0:1789185758.568468:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 133 00000100:00100000:2.0:1789185758.568474:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879501056:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185758.568500:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879501056:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 27us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.568514:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 133 00000100:00100000:2.0:1789185758.568526:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 134 00000100:00100000:2.0:1789185758.568532:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879501184:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185758.568557:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879501184:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.568563:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 134 00000100:00080000:2.0:1789185758.568587:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185758.568591:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185758.568594:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185758.568596:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185758.568871:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 342 00000100:00100000:0.0:1789185758.568879:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+14:2392:x1876096879500800:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185758.568948:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+14:2392:x1876096879500800:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 71us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185758.569035:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 342 00000100:00100000:3.0:1789185758.570050:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879500672 00000100:00100000:3.0:1789185758.570060:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879500672 00000100:00100000:3.0:1789185758.570120:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 392 00000100:00100000:3.0:1789185758.570129:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879500672:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185758.570189:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879500672:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 62us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185758.570197:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 392 00000100:00100000:1.0:1789185758.633459:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898451456:0@lo:400:kworker.0 00000100:00100000:1.0:1789185758.633548:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185758.633605:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898451968:0@lo:400:kworker.0 00000100:00100000:1.0:1789185758.633632:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185758.633671:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898452480:0@lo:400:kworker.0 00000100:00100000:1.0:1789185758.633692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185758.633721:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789185758.633727:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898451328:0@lo:400:kworker.0 00000100:00100000:1.0:1789185758.633748:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185758.633765:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898451840:0@lo:400:kworker.0 00000100:00100000:1.0:1789185758.633782:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185758.633800:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898452352:0@lo:400:kworker.0 00000100:00100000:1.0:1789185758.633817:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185758.633857:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898451968 00000100:00100000:1.0:1789185758.633865:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898451968 00000100:00100000:1.0:1789185758.633932:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898452480 00000100:00100000:1.0:1789185758.633937:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898452480 00000100:00100000:1.0:1789185758.633951:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898451328 00000100:00100000:2.0:1789185758.634138:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898451584:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185758.634190:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898452096:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634224:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185758.634245:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898452608:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634266:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185758.634284:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789185758.634290:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898451200:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634320:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185758.634341:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898451712:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634363:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185758.634382:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898452224:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634403:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185758.634419:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898452736:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634452:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185758.634482:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898451456 00000100:00100000:2.0:1789185758.634487:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898451456 00000100:00100000:2.0:1789185758.634512:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898451712 00000100:00100000:2.0:1789185758.634515:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898451712 00000100:00100000:2.0:1789185758.634532:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789185758.634541:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898451456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634601:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898451456:12345-0@lo:400:kworker.0 Request processed in 60us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.634608:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789185758.634626:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789185758.634633:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898451712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634678:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898451712:12345-0@lo:400:kworker.0 Request processed in 45us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.634683:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789185758.634702:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898452096 00000100:00100000:2.0:1789185758.634705:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898452096 00000100:00100000:2.0:1789185758.634724:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898452608 00000100:00100000:2.0:1789185758.634726:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898452608 00000100:00100000:2.0:1789185758.634738:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898452224 00000100:00100000:2.0:1789185758.634741:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898452224 00000100:00100000:2.0:1789185758.634751:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898452736 00000100:00100000:2.0:1789185758.634753:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898452736 00000100:00100000:2.0:1789185758.634767:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789185758.634773:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898452096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634805:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898452096:12345-0@lo:400:kworker.0 Request processed in 31us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.634811:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789185758.634829:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789185758.634835:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898452608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.634868:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898452608:12345-0@lo:400:kworker.0 Request processed in 33us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.634874:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789185758.634885:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789185758.634891:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898452224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635093:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898452224:12345-0@lo:400:kworker.0 Request processed in 201us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.635099:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789185758.635114:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789185758.635121:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898452736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635150:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898452736:12345-0@lo:400:kworker.0 Request processed in 30us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.635155:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789185758.635206:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898451712:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635279:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898452224:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635290:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898452736:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635300:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898452096:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635310:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898452608:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635355:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898451456:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635393:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898451840 00000100:00100000:2.0:1789185758.635398:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898451840 00000100:00100000:2.0:1789185758.635428:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898452352 00000100:00100000:2.0:1789185758.635430:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898452352 00000100:00100000:2.0:1789185758.635442:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898451584 00000100:00100000:2.0:1789185758.635445:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898451584 00000100:00100000:2.0:1789185758.635459:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789185758.635465:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898451968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635505:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898451968:12345-0@lo:400:kworker.0 Request processed in 40us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.635509:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789185758.635522:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789185758.635528:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898452480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635554:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898452480:12345-0@lo:400:kworker.0 Request processed in 27us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.635559:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789185758.635571:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789185758.635576:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898451840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635603:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898451840:12345-0@lo:400:kworker.0 Request processed in 27us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.635608:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789185758.635620:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789185758.635626:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898452352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635663:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898452352:12345-0@lo:400:kworker.0 Request processed in 25us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.635670:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789185758.635681:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789185758.635686:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c1325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898451584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635740:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c1325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898451584:12345-0@lo:400:kworker.0 Request processed in 53us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185758.635747:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789185758.635777:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898451840:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635786:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898452352:0@lo:400:kworker.0 00010000:00080000:2.0:1789185758.635797:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c40c2300 x1876096898451968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185758.635807:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898451968:0@lo:400:kworker.0 00010000:00080000:2.0:1789185758.635816:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c40c2a00 x1876096898452480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185758.635824:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898452480:0@lo:400:kworker.0 00000100:00100000:2.0:1789185758.635852:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898451584:0@lo:400:kworker.0 00000100:00080000:2.0:1789185758.635885:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185758.635889:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185758.635891:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185758.635893:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185758.636009:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898451328 00000100:00100000:1.0:1789185758.636043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789185758.636050:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898451328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185758.636087:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898451328:12345-0@lo:400:kworker.0 Request processed in 38us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185758.636093:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789185758.636118:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898451328:0@lo:400:kworker.0 00000100:00100000:3.0:1789185758.636482:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898451200 00000100:00100000:3.0:1789185758.636488:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898451200 00000100:00100000:3.0:1789185758.636554:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789185758.636561:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898451200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185758.636604:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898451200:12345-0@lo:400:kworker.0 Request processed in 44us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185758.636618:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789185758.636717:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898451200:0@lo:400:kworker.0 00000100:00100000:3.0:1789185758.636732:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185758.636740:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898452864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185758.636772:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185758.636800:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898452864 00000100:00100000:3.0:1789185758.636804:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898452864 00000100:00100000:3.0:1789185758.636829:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789185758.636835:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898452864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185758.636858:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185758.636891:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898452864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185758.636896:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789185758.636942:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898452864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185758.637087:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185758.637095:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898452992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185758.637123:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185758.637161:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898452992 00000100:00100000:0.0:1789185758.637165:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898452992 00000100:00100000:0.0:1789185758.637193:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789185758.637200:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898452992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789185758.637211:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185758.637255:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898452992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185758.637261:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789185758.637288:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898452992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185758.638191:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185758.638204:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898453120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185758.638249:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185758.638385:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898453120 00000100:00100000:1.0:1789185758.638391:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898453120 00000100:00100000:1.0:1789185758.638444:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789185758.638453:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898453120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185758.638480:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789185758.638522:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898453120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185758.638528:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789185758.638648:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898453120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789185759.526268:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789185759.590037:0:14519:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:02:37 (1789185757) 00000001:00080000:1.0:1789185759.657962:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1789185759.657978:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789185759.657995:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789185759.658011:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789185760.170956:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898453248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185760.171035:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185760.174371:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898453248 00000100:00100000:1.0:1789185760.174388:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898453248 00000100:00100000:1.0:1789185760.174464:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789185760.174475:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898453248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185760.174512:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185760.174605:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898453248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (3570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185760.174612:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789185760.174839:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898453248:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789185760.550212:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185761.126494:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185761.135461:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879501696 00000100:00100000:3.0:1789185761.135478:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879501696 00000100:00100000:3.0:1789185761.135693:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 149 00000100:00100000:3.0:1789185761.135705:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+13:12148:x1876096879501696:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185761.135726:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185761.135747:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73779 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fc2 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.135821:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.135835:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.135863:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.135879:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.135885:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.135890:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136233:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a7378e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136243:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a7378e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136250:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a7378e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185761.136260:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789185761.136357:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136364:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136371:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136376:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185761.136388:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136395:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136407:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f1c33d9d00) 00010000:00010000:3.0:1789185761.136410:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185761.136415:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136422:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a73780 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136437:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136443:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136447:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136452:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185761.136454:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136460:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136468:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98f2c4f8d100) 00010000:00010000:3.0:1789185761.136470:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185761.136479:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.136485:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73787 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.140236:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73779 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fc2 expref: 16 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789185761.140241:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789185761.140265:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a7378e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fc2 expref: 15 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185761.140276:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:3.0:1789185761.140279:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185761.140282:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166da00, rc 0) 00000100:00100000:3.0:1789185761.140375:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+15:12148:x1876096879501696:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 4670us (13889us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789185761.140385:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 149 00000100:00100000:2.0:1789185761.148486:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185761.148600:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185761.148717:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879501824 00000100:00100000:0.0:1789185761.148728:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879501824 00000100:00100000:0.0:1789185761.148803:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00100000:0.0:1789185761.148814:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+15:2390:x1876096879501824:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185761.148830:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185761.148855:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a7378e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fc2 expref: 15 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185761.148898:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:0.0:1789185761.148903:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185761.149013:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+14:2390:x1876096879501824:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 199us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185761.149020:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00100000:1.0:1789185761.150436:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879501952 00000100:00100000:1.0:1789185761.150447:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879501952 00000100:00100000:1.0:1789185761.150507:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 150 00000100:00100000:1.0:1789185761.150517:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+14:12148:x1876096879501952:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789185761.150630:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+14:12148:x1876096879501952:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 Request processed in 114us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185761.150637:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 150 00000100:00100000:2.0:1789185761.158249:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185761.158737:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879502080 00000100:00100000:0.0:1789185761.158748:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879502080 00000100:00100000:0.0:1789185761.158869:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 151 00000100:00100000:0.0:1789185761.158880:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:12148:x1876096879502080:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789185761.159022:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:12148:x1876096879502080:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 Request processed in 144us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185761.159030:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 151 00000100:00080000:2.0:1789185761.159747:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185761.190347:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898453376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185761.190426:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185761.190691:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185761.190699:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898453504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185761.190725:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185761.190754:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898453376 00000100:00100000:0.0:1789185761.190761:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898453376 00000100:00100000:0.0:1789185761.190809:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898453504 00000100:00100000:0.0:1789185761.190812:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898453504 00000100:00100000:0.0:1789185761.190827:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789185761.190849:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898453376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185761.190878:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789185761.190939:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898453376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185761.191035:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789185761.191056:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789185761.191062:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898453504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185761.191072:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789185761.191098:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898453504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185761.191104:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789185761.191147:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898453504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185761.191161:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898453376:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789185761.191941:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789185761.585269:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185761.961564:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185761.961577:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185761.962118:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789185761.962128:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789185762.086628:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789185762.598158:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185762.982061:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185762.982070:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185762.982173:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1789185762.982180:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789185763.144820:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.144903:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879502208 00000100:00100000:3.0:1789185763.144938:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879502208 00000100:00100000:3.0:1789185763.145013:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 152 00000100:00100000:3.0:1789185763.145023:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+14:12191:x1876096879502208:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185763.145055:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185763.145077:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a7379c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fc9 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145143:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145158:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145170:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145183:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145190:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145195:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145240:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145247:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145253:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145260:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185763.145271:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145278:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145290:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2800) 00010000:00010000:3.0:1789185763.145293:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185763.145298:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145303:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145316:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145322:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145328:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145333:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185763.145336:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145341:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145348:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98f2c4f8d100) 00010000:00010000:3.0:1789185763.145350:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185763.145359:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145366:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145402:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a7379c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fc9 expref: 15 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145411:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2800) 00010000:00010000:3.0:1789185763.145414:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185763.145417:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a7379c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fc9 expref: 15 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.145427:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166d400, rc 0) 00000100:00100000:3.0:1789185763.145490:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+14:12191:x1876096879502208:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 469us (681us total) trans 0 rc 301/301 00000100:00100000:3.0:1789185763.145498:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 152 00000100:00080000:0.0:1789185763.145578:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185763.155708:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.160083:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879502464 00000100:00100000:3.0:1789185763.160101:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879502464 00000100:00100000:3.0:1789185763.160188:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 153 00000100:00100000:3.0:1789185763.160200:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+14:12191:x1876096879502464:12345-192.168.204.48@tcp:36:lfs.0 00010000:00010000:3.0:1789185763.160260:0:9473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185763.160288:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a730fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51df4 expref: 14 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.160310:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2800) 00010000:00010000:3.0:1789185763.160322:0:9473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185763.160405:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.160427:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.160440:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.160452:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.160460:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.160467:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162032:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162053:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162064:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185763.162080:0:9473:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b053cf23 reply state 00000000a326c4c9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162091:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162099:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:3.0:1789185763.162108:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185763.162111:0:9473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789185763.162118:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789185763.162126:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162133:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162140:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162145:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185763.162150:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162157:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162168:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2c4f8d100) 00010000:00010000:3.0:1789185763.162171:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185763.162174:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162180:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185763.162197:0:9473:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b053cf23 reply state 00000000a326c4c9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162206:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.162222:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98f2c4f8d200) 00010000:00010000:3.0:1789185763.162225:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185763.162227:0:9473:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789185763.162335:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+15:12191:x1876096879502464:12345-192.168.204.48@tcp:36:lfs.0 Request processed in 2134us (6634us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789185763.162343:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 153 00000100:00100000:1.0:1789185763.285447:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185763.285701:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879502592 00000100:00100000:0.0:1789185763.285712:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879502592 00000100:00100000:0.0:1789185763.285780:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 154 00000100:00100000:0.0:1789185763.285792:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+15:12199:x1876096879502592:12345-192.168.204.48@tcp:101:lctl.0 00010000:00010000:0.0:1789185763.285819:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185763.285842:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a737c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fd0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.285955:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a737cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.285970:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a737cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.286002:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a737cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185763.286055:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789185763.286060:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185763.286081:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a737cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.286108:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a737c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fd0 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.286127:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a737cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fd0 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.286136:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2700) 00010000:00010000:0.0:1789185763.286139:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185763.286143:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dae00, rc 0) 00000100:00100000:0.0:1789185763.286455:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+16:12199:x1876096879502592:12345-192.168.204.48@tcp:101:lctl.0 Request processed in 664us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185763.286463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 154 00000100:00100000:1.0:1789185763.366850:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185763.368700:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879502720 00000100:00100000:2.0:1789185763.368716:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879502720 00000100:00100000:2.0:1789185763.368805:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 155 00000100:00100000:2.0:1789185763.368817:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+16:12205:x1876096879502720:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185763.368839:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185763.368861:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a737d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.368958:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.368990:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369004:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369018:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369026:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369032:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369124:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a737e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369149:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a737e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369157:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a737e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185763.369193:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789185763.369196:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185763.369217:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a737e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369228:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369235:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369241:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369247:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185763.369252:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369260:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369273:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2700) 00010000:00010000:2.0:1789185763.369276:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185763.369281:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369298:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e800/0xda5c730d5a737db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369315:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369321:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369327:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369332:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402ec00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185763.369335:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369340:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369347:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98f2c4f8d200) 00010000:00010000:2.0:1789185763.369350:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185763.369353:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369358:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a737e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369385:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a737d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fd7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369399:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a737e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fd7 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.369420:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185763.369423:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789185763.369425:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f400, rc 0) 00000100:00100000:2.0:1789185763.369520:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+17:12205:x1876096879502720:12345-192.168.204.48@tcp:101:bash.0 Request processed in 704us (2678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185763.369527:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 155 00000100:00100000:2.0:1789185763.389166:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.389398:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879502976 00000100:00100000:3.0:1789185763.389410:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879502976 00000100:00100000:3.0:1789185763.390650:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 156 00000100:00100000:3.0:1789185763.390668:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+17:12205:x1876096879502976:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185763.390691:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185763.390712:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fde expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.390815:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.390829:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.390841:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.390892:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.390901:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.391185:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789185763.391702:0:9473:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789185763.391965:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.393926:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.393948:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394088:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394096:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394104:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394110:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166da00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185763.394114:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394121:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394134:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:3.0:1789185763.394137:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185763.394157:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394163:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a737f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185763.394180:0:9473:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000076ad6b4a reply state 0000000030b621e2 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394191:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394197:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2c4f8d100) 00010000:00010000:3.0:1789185763.394199:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185763.394761:0:9473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789185763.394822:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d400/0xda5c730d5a737f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fde expref: 20 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394842:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fde expref: 19 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.394849:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f2c4f8d400) 00010000:00010000:3.0:1789185763.394851:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185763.394853:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185763.394991:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+20:12205:x1876096879502976:12345-192.168.204.48@tcp:101:bash.0 Request processed in 4330us (5833us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789185763.395008:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 156 00000100:00100000:3.0:1789185763.402040:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185763.402486:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879503104 00000100:00100000:2.0:1789185763.402496:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879503104 00000100:00100000:2.0:1789185763.402594:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00080000:0.0:1789185763.402597:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789185763.402608:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879503104:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185763.402627:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185763.402649:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fe5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185763.402676:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185763.402697:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=402s v=(0 0) 00010000:00010000:2.0:1789185763.402701:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185763.402711:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fe5 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.402730:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fe5 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.402741:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f200, rc 0) 00000100:00100000:2.0:1789185763.402819:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879503104:12345-192.168.204.48@tcp:101:bash.0 Request processed in 216us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185763.402826:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00100000:1.0:1789185763.407995:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185763.408413:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879503232 00000100:00100000:2.0:1789185763.408425:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879503232 00000100:00100000:2.0:1789185763.408552:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00100000:2.0:1789185763.408574:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+6:12205:x1876096879503232:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185763.408593:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185763.408612:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51fec expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.408645:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fe5 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.408653:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185763.408658:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185763.408663:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.408698:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fe5 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.408712:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fe5 expref: 7 pid: 8430 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185763.408726:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876096898453632:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185763.408895:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085300 going to sleep for 11 seconds 00000100:00100000:0.0:1789185763.425825:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.426136:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879503360 00000100:00100000:1.0:1789185763.426146:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879503360 00010000:00010000:1.0:1789185763.426183:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fe5 expref: 8 pid: 8430 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.426222:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 79 00000100:00100000:1.0:1789185763.426230:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879503360:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185763.426244:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185763.426264:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fe5 expref: 8 pid: 8430 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.426277:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fe5 expref: 8 pid: 8430 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.426300:0:10394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185763.426305:0:10394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185763.426312:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.426332:0:10394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.426368:0:10394:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.426381:0:10394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10394:1876096898453760:192.168.204.48@tcp:105: 00000100:00100000:1.0:1789185763.426484:0:10394:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3000766c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789185763.427185:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c920560/0xda5c730d5a73813 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fe5 expref: 8 pid: 8430 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185763.427202:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876096898453632:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185763.427225:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.427236:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ec00, rc 0) 00000100:00100000:2.0:1789185763.427287:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:12205:x1876096879503232:12345-192.168.204.48@tcp:101:bash.0 Request processed in 18725us (19300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185763.427295:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00100000:0.0:1789185763.435881:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.436609:0:10394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10394:1876096898453760:192.168.204.48@tcp:105: 00010000:00010000:1.0:1789185763.436778:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185763.436852:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879503360:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 10620us (11034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.436863:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 79 00000100:00100000:3.0:1789185763.437350:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879503616 00000100:00100000:3.0:1789185763.437358:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879503616 00000100:00100000:3.0:1789185763.437438:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 36 00000100:00100000:3.0:1789185763.437448:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+20:12205:x1876096879503616:12345-192.168.204.48@tcp:35:bash.0 00000100:00100000:3.0:1789185763.437763:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:12205:x1876096879503616:12345-192.168.204.48@tcp:35:bash.0 Request processed in 315us (1890us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789185763.437770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 36 00000100:00100000:2.0:1789185763.538419:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185763.538505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879503872 00000100:00100000:0.0:1789185763.538519:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879503872 00000100:00100000:0.0:1789185763.538728:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 157 00000100:00100000:0.0:1789185763.538741:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:12215:x1876096879503872:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185763.539163:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185763.539209:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73821 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ff3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185763.539355:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789185763.539489:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73821 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ff3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.539506:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2700) 00010000:00010000:0.0:1789185763.539510:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185763.539517:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73821 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ff3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.539535:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db800, rc 0) 00000100:00100000:0.0:1789185763.540062:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:12215:x1876096879503872:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1322us (1657us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1789185763.540073:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 157 00000100:00100000:2.0:1789185763.543366:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.543459:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879504128 00000100:00100000:3.0:1789185763.543472:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879504128 00000100:00100000:3.0:1789185763.543542:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 37 00000100:00100000:3.0:1789185763.543629:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:12215:x1876096879504128:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185763.544577:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+23:12215:x1876096879504128:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 1009us (1209us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789185763.544590:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 37 00010000:00010000:0.0:1789185763.622173:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185763.623432:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.623805:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879504256 00000100:00100000:1.0:1789185763.623820:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879504256 00000100:00100000:2.0:1789185763.623983:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 158 00000100:00100000:2.0:1789185763.623999:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+23:12221:x1876096879504256:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185763.624036:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185763.624063:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a7382f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee51ffa expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.624163:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73836 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.624183:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.624222:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185763.624299:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789185763.624304:0:8147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185763.624327:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.624368:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a7382f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ffa expref: 25 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.624396:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ffa expref: 24 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.624406:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185763.624408:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185763.624413:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402fa00, rc 0) 00000100:00100000:2.0:1789185763.624505:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12221:x1876096879504256:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 510us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185763.624513:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 158 00000100:00100000:2.0:1789185763.628448:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.628543:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879504512 00000100:00100000:3.0:1789185763.628569:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879504512 00000100:00100000:3.0:1789185763.628646:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 159 00000100:00100000:3.0:1789185763.628657:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12221:x1876096879504512:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185763.628688:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185763.628729:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7383d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52001 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.628891:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73844 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.628954:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.628969:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185763.629003:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789185763.629148:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7383d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52001 expref: 27 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.629171:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73844 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52001 expref: 26 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.629179:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f2c4f8d400) 00010000:00010000:3.0:1789185763.629182:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185763.629187:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db600, rc 0) 00000100:00100000:3.0:1789185763.629266:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+26:12221:x1876096879504512:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 610us (832us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789185763.629274:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 159 00000100:00100000:3.0:1789185763.634295:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185763.638308:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879504768 00000100:00100000:0.0:1789185763.638331:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879504768 00000100:00100000:0.0:1789185763.638420:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 160 00000100:00100000:0.0:1789185763.638434:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+26:12221:x1876096879504768:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185763.638468:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185763.638498:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73852 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52008 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.638664:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73859 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.638682:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73859 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.638943:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73859 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185763.638962:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789185763.639104:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73852 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52008 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.639127:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73859 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52008 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.639136:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f2c4f8d400) 00010000:00010000:0.0:1789185763.639139:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789185763.639144:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dbc00, rc 0) 00000100:00100000:0.0:1789185763.639259:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+28:12221:x1876096879504768:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 826us (4978us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1789185763.639268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 160 00000100:00100000:0.0:1789185763.640998:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185763.641204:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879504896 00000100:00100000:2.0:1789185763.641218:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879504896 00000100:00100000:2.0:1789185763.641327:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:2.0:1789185763.641342:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+28:2389:x1876096879504896:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185763.641362:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185763.641399:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73844 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52001 expref: 28 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.641440:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f2c4f8d400) 00010000:00010000:2.0:1789185763.641447:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185763.641526:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+27:2389:x1876096879504896:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 187us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185763.641534:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:2.0:1789185763.652032:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185763.652340:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879505024 00000100:00100000:0.0:1789185763.652355:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879505024 00000100:00100000:0.0:1789185763.652433:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 57 00000100:00100000:0.0:1789185763.652447:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879505024:12345-192.168.204.48@tcp:1:lfs.0 00010000:00010000:0.0:1789185763.652514:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.652540:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.652586:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185763.652592:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185763.652597:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.652647:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.652665:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 6 pid: 8429 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185763.652684:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876096898453888:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185763.652869:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e05f7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185763.657215:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185763.657303:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876096898453888:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185763.657347:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185763.658258:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879505152 00000100:00100000:2.0:1789185763.658273:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879505152 00002000:00100000:2.0:1789185763.658356:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff98f1c35e2d80 x1876096879505152/t0(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:364/0 lens 504/0 e 0 to 0 dl 1789185774 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185763.658369:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c35e2d80 with x1876096879505152 ext(0->12) 00010000:00010000:2.0:1789185763.658379:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 7 pid: 8429 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.658398:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 7 pid: 8429 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185763.658408:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f1c35e2d80 00000100:00100000:2.0:1789185763.658459:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:2.0:1789185763.658472:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879505152:12345-192.168.204.48@tcp:4:lfs.0 00000100:00100000:2.0:1789185763.660035:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879505152:12345-192.168.204.48@tcp:4:lfs.0 Request processed in 1544us (2816us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789185763.660051:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 2 00002000:00100000:2.0:1789185763.660064:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff98f1c35e2d80 x1876096879505152/t4294967306(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:364/0 lens 504/448 e 0 to 0 dl 1789185774 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185763.660089:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c35e2d80 with x1876096879505152 ext(0->12) 00010000:00010000:2.0:1789185763.660100:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 9 pid: 8429 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.660120:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 9 pid: 8429 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185763.660129:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f1c35e2d80 00000100:00100000:2.0:1789185763.665058:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.670751:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879505280 00000100:00100000:3.0:1789185763.670775:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879505280 00010000:00010000:3.0:1789185763.670846:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 9 pid: 8429 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185763.670904:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 80 00000100:00100000:3.0:1789185763.670939:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2392:x1876096879505280:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185763.670960:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789185763.670985:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789185763.670988:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789185763 00002000:00010000:3.0:1789185763.670991:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789185763 00002000:00010000:3.0:1789185763.671012:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789185763 00002000:00010000:3.0:1789185763.671013:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789185763.671022:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 9 pid: 8429 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.671039:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 9 pid: 8429 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.671072:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7381a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fec expref: 9 pid: 8429 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.671093:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185763.671097:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185763.671105:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.671118:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.671277:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185763.671367:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879505280:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 431us (6325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.671376:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 80 00010000:00010000:0.0:1789185763.674989:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.675144:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.675193:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.675228:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.675237:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.675246:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185763.675252:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.675262:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.675289:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185763.675297:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a0f7442/0xda5c730d5a73867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.675723:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879505024:12345-192.168.204.48@tcp:1:lfs.0 Request processed in 23271us (23697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.675736:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 57 00000100:00100000:2.0:1789185763.680315:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.680735:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879505536 00000100:00100000:1.0:1789185763.680750:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879505536 00000100:00100000:1.0:1789185763.680861:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 38 00000100:00100000:1.0:1789185763.680874:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6594450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12221:x1876096879505536:12345-192.168.204.48@tcp:35:lfs.0 00000004:00010000:1.0:1789185763.681003:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73859 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52008 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185763.681300:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789185763.681337:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789185763.682498:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789185763.682801:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.682826:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fde expref: 31 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.682837:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.683035:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fde expref: 31 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.683059:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fde expref: 31 pid: 9473 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.683079:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c40c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1876096898454016:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185763.683207:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3000766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185763.693770:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.694296:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c40c1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1876096898454016:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185763.694340:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.694496:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.694527:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.694567:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.694596:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.694625:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.694662:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879506176 00000100:00100000:1.0:1789185763.694671:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879506176 00000100:00100000:1.0:1789185763.694740:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879505792 00000100:00100000:1.0:1789185763.694744:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879505792 00000100:00100000:1.0:1789185763.694767:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879506048 00000100:00100000:1.0:1789185763.694770:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879506048 00000100:00100000:1.0:1789185763.694790:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 349 00000100:00100000:1.0:1789185763.694801:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879506176:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185763.694895:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879506176:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 94us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.694902:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 349 00000100:00100000:1.0:1789185763.694946:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 350 00000100:00100000:1.0:1789185763.694962:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879505792:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185763.694993:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2391:x1876096879505792:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 32us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.694999:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 350 00000100:00100000:1.0:1789185763.695013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 351 00000100:00100000:1.0:1789185763.695019:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879506048:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185763.695045:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879506048:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.695052:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 351 00000100:00100000:2.0:1789185763.696214:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879505920 00000100:00100000:2.0:1789185763.696227:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879505920 00000100:00100000:2.0:1789185763.696291:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 139 00000100:00100000:2.0:1789185763.696301:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879505920:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185763.696360:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879505920:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 61us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185763.696368:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 139 00000100:00080000:1.0:1789185763.696762:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185763.696768:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185763.696771:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185763.696788:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879506304 00000100:00100000:1.0:1789185763.696793:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879506304 00010000:00010000:1.0:1789185763.696823:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fde expref: 32 pid: 9473 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.697153:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 81 00000100:00100000:1.0:1789185763.697163:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+32:2391:x1876096879506304:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185763.697178:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185763.697186:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fde expref: 32 pid: 9473 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.697201:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fde expref: 32 pid: 9473 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.697253:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73805 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fde expref: 32 pid: 9473 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.697274:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f2c4f8d400) 00010000:00010000:1.0:1789185763.697280:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.697291:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.697299:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.697324:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185763.697363:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+31:2391:x1876096879506304:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 202us (2737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.697370:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 81 00010000:00010000:3.0:1789185763.697424:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.697434:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185763.697619:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1789185763.697764:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789185763.697884:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876096898454144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789185763.697992:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185763.698028:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22aa540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185763.698054:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898454144 00000100:00100000:3.0:1789185763.698059:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898454144 00000100:00100000:3.0:1789185763.698113:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789185763.698120:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1876096898454144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789185763.698207:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1876096898454144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.698215:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789185763.698268:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876096898454144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789185763.698412:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789185763.698461:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876096898454272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789185763.698491:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185763.698512:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c22aa180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185763.698528:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898454272 00000100:00100000:3.0:1789185763.698532:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898454272 00000100:00100000:3.0:1789185763.698570:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789185763.698577:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1876096898454272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789185763.698713:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1876096898454272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 136us (221us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789185763.698721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789185763.698773:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879505664 00000100:00100000:0.0:1789185763.698782:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879505664 00000100:00080000:1.0:1789185763.698805:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185763.698829:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 394 00000100:00100000:0.0:1789185763.698840:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879505664:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185763.698903:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879505664:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 65us (5148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185763.698939:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 394 00000100:00100000:2.0:1789185763.700846:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f300ed7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876096898454272:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789185763.700994:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1789185763.701075:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.701088:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.701097:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.701119:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1a00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185763.701125:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.701134:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.701155:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f2c4f8d400) 00010000:00010000:2.0:1789185763.701158:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789185763.701165:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.701171:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a7386e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789185763.701320:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789185763.701402:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789185763.701417:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402863508275ns, next at 403863504832ns, rc = 0 00000001:00080000:2.0:1789185763.701425:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1789185763.701453:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f2c4f8d400) 00010000:00010000:2.0:1789185763.701456:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789185763.701466:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73859 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52008 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185763.701634:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6594450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+34:12221:x1876096879505536:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 20761us (21332us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1789185763.701644:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 38 00000020:00080000:2.0:1789185763.701652:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789185763.704188:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.707444:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879506432 00000100:00100000:1.0:1789185763.707473:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879506432 00000100:00100000:1.0:1789185763.707721:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 161 00000100:00100000:1.0:1789185763.707735:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+34:12221:x1876096879506432:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185763.707771:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185763.707804:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73875 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5200f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.707879:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73875 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5200f expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.707940:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73875 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5200f expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.707962:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185763.707966:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185763.707971:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1000, rc 0) 00000100:00100000:1.0:1789185763.708062:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+35:12221:x1876096879506432:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 331us (3892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.708070:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 161 00000100:00100000:0.0:1789185763.713036:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.713129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879506688 00000100:00100000:3.0:1789185763.713143:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879506688 00000100:00100000:3.0:1789185763.713213:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 39 00000100:00100000:3.0:1789185763.713226:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+35:12221:x1876096879506688:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185763.713584:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+36:12221:x1876096879506688:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 359us (563us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789185763.713594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 39 00000100:00100000:2.0:1789185763.750265:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c37a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898454400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185763.750375:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185763.750544:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898454400 00000100:00100000:3.0:1789185763.750567:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898454400 00000100:00100000:3.0:1789185763.750637:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789185763.750650:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898454400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185763.750683:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185763.750749:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898454400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.750758:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789185763.750964:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c37a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898454400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185763.751335:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898454656:0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.751388:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185763.751421:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898455168:0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.751445:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185763.751471:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898455680:0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.751497:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185763.751525:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789185763.751530:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898454784:0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.751570:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185763.751588:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898455296:0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.751621:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185763.751639:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898455808:0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.751664:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185763.751695:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898454656 00000100:00100000:1.0:1789185763.751700:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898454656 00000100:00100000:1.0:1789185763.751745:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898455168 00000100:00100000:1.0:1789185763.751749:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898455168 00000100:00100000:1.0:1789185763.751774:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898455680 00000100:00100000:1.0:1789185763.751777:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898455680 00000100:00100000:1.0:1789185763.751792:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898455296 00000100:00100000:1.0:1789185763.751794:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898455296 00000100:00100000:1.0:1789185763.751810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898455808 00000100:00100000:1.0:1789185763.751813:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898455808 00000100:00100000:1.0:1789185763.751829:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789185763.751837:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898454656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.751888:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898454656:12345-0@lo:400:kworker.0 Request processed in 52us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.751895:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789185763.751942:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789185763.751949:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898455168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.751978:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898455168:12345-0@lo:400:kworker.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.751984:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789185763.751997:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789185763.752003:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898455680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.752031:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898455680:12345-0@lo:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.752036:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789185763.752048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789185763.752054:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898455296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.752080:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898455296:12345-0@lo:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.752099:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789185763.752111:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789185763.752117:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898455808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.752143:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898455808:12345-0@lo:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.752149:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00080000:1.0:1789185763.752166:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185763.752171:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185763.752200:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c4145880 x1876096898455296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185763.752212:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898455296:0@lo:400:kworker.0 00010000:00080000:1.0:1789185763.752221:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c4155f80 x1876096898455808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185763.752229:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898455808:0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.752238:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898454656:0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.752247:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898455168:0@lo:400:kworker.0 00000100:00100000:1.0:1789185763.752255:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898455680:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.752489:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898454784 00000100:00100000:3.0:1789185763.752494:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898454784 00000100:00100000:3.0:1789185763.752536:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789185763.752544:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c40c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898454784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.752609:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c40c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898454784:12345-0@lo:400:kworker.0 Request processed in 67us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.752615:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789185763.752637:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898454912:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.752675:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185763.752697:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898455424:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.752725:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185763.752745:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898455936:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.752767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185763.752786:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789185763.752792:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898454528:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.752820:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185763.752846:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898455040:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.752868:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185763.752885:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898455552:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.752938:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185763.752970:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898455424 00000100:00100000:3.0:1789185763.752974:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898455424 00000100:00100000:3.0:1789185763.753007:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898455936 00000100:00100000:3.0:1789185763.753011:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898455936 00000100:00100000:3.0:1789185763.753026:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898455552 00000100:00100000:3.0:1789185763.753029:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898455552 00000100:00100000:3.0:1789185763.753043:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789185763.753049:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898455424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753088:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898455424:12345-0@lo:400:kworker.0 Request processed in 40us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.753094:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789185763.753107:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789185763.753113:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898455936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753141:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898455936:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.753155:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789185763.753168:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789185763.753173:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898455552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753200:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898455552:12345-0@lo:400:kworker.0 Request processed in 27us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.753205:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789185763.753222:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898454528 00000100:00100000:3.0:1789185763.753225:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898454528 00000100:00100000:3.0:1789185763.753247:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789185763.753253:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898454528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753282:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898454528:12345-0@lo:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.753288:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789185763.753316:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898455040 00000100:00100000:3.0:1789185763.753319:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898455040 00000100:00100000:3.0:1789185763.753340:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789185763.753346:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898455040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753377:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898455040:12345-0@lo:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.753382:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789185763.753422:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898454528:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753434:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898455040:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753443:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898455552:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753453:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898455424:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753473:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898455936:0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753504:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898454912 00000100:00100000:3.0:1789185763.753508:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898454912 00000100:00100000:3.0:1789185763.753533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789185763.753539:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898454912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185763.753590:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898454912:12345-0@lo:400:kworker.0 Request processed in 52us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.753596:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789185763.753622:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898454912:0@lo:400:kworker.0 00000100:00080000:1.0:1789185763.753839:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185763.753844:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185763.753869:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898454784:0@lo:400:kworker.0 00000100:00100000:2.0:1789185763.754467:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898456192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185763.754518:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185763.754676:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898456192 00000100:00100000:1.0:1789185763.754683:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898456192 00000100:00100000:1.0:1789185763.754727:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789185763.754749:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898456192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185763.754786:0:6517:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789185763.754833:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898456192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.754840:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789185763.754955:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898456192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185763.755050:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898456064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185763.755089:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185763.755167:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898456064 00000100:00100000:2.0:1789185763.755171:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898456064 00000100:00100000:2.0:1789185763.755212:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789185763.755220:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898456064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789185763.755235:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185763.755282:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898456064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185763.755288:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789185763.755361:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898456064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185763.816028:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185763.816151:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879506944 00000100:00100000:2.0:1789185763.816166:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879506944 00000100:00100000:2.0:1789185763.816254:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 162 00000100:00100000:2.0:1789185763.816267:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+36:12231:x1876096879506944:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185763.816302:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185763.816333:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7387c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52016 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185763.816472:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789185763.816617:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7387c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52016 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.816660:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2700) 00010000:00010000:2.0:1789185763.816665:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185763.816672:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a7387c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52016 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185763.816690:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f800, rc 0) 00000100:00100000:2.0:1789185763.816759:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+37:12231:x1876096879506944:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 494us (746us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789185763.816768:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 162 00000100:00100000:0.0:1789185763.820025:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.822361:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879507072 00000100:00100000:3.0:1789185763.822384:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879507072 00000100:00100000:3.0:1789185763.822477:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 163 00000100:00100000:3.0:1789185763.822490:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ffa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+37:12231:x1876096879507072:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:3.0:1789185763.822620:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822644:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822659:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822672:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822680:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822710:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822809:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822818:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822825:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185763.822888:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822905:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822939:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822947:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822954:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185763.822959:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822968:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.822984:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:3.0:1789185763.822993:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185763.823000:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823007:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7388a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823023:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823029:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823036:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823041:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185763.823044:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823050:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823058:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2c4f8d100) 00010000:00010000:3.0:1789185763.823061:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185763.823063:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823070:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73891 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823080:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823092:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823098:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823104:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185763.823106:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823112:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823120:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185763.823123:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185763.823126:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185763.823132:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73898 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185763.823234:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ffa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+37:12231:x1876096879507072:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 744us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185763.823244:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 163 00000100:00100000:0.0:1789185763.825679:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.825768:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879507328 00000100:00100000:3.0:1789185763.825781:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879507328 00000100:00100000:3.0:1789185763.825849:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 40 00000100:00100000:3.0:1789185763.825860:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+37:12231:x1876096879507328:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185763.826169:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+38:12231:x1876096879507328:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 310us (501us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789185763.826194:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 40 00000100:00100000:0.0:1789185763.879321:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.879465:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879507584 00000100:00100000:1.0:1789185763.879480:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879507584 00000100:00100000:1.0:1789185763.879575:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 164 00000100:00100000:1.0:1789185763.879588:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+38:12234:x1876096879507584:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185763.879623:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185763.879652:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7389f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5201d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.879770:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.879788:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.879804:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.879816:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.879824:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.879856:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880274:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880285:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880293:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185763.880305:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789185763.880404:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880414:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880423:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880430:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185763.880436:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880446:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880461:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185763.880465:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185763.880478:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880485:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a738a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880503:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880511:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880517:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880524:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185763.880527:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880534:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880543:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2c4f8d100) 00010000:00010000:1.0:1789185763.880545:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185763.880548:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880749:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880801:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a7389f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5201d expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880831:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5201d expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.880840:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185763.880842:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185763.880845:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0000, rc 0) 00000100:00100000:1.0:1789185763.881055:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+40:12234:x1876096879507584:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1467us (1748us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789185763.881064:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 164 00000100:00100000:0.0:1789185763.899482:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185763.899612:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879507712 00000100:00100000:1.0:1789185763.899626:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879507712 00000100:00100000:1.0:1789185763.899717:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 165 00000100:00100000:1.0:1789185763.899730:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+40:12234:x1876096879507712:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:1.0:1789185763.899827:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.899850:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.899865:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.899939:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.899948:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.900153:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.900161:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185763.900167:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.900176:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.900190:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185763.900194:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185763.900200:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185763.900207:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185763.900375:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+40:12234:x1876096879507712:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 646us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185763.900384:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 165 00000100:00100000:0.0:1789185763.903618:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185763.903717:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879507968 00000100:00100000:3.0:1789185763.903731:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879507968 00000100:00100000:3.0:1789185763.903807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:3.0:1789185763.903819:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+40:12234:x1876096879507968:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185763.904171:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+41:12234:x1876096879507968:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 353us (569us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789185763.904179:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:0.0:1789185764.223332:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185764.223505:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879508224 00000100:00100000:1.0:1789185764.223520:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879508224 00000100:00100000:1.0:1789185764.223770:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 166 00000100:00100000:1.0:1789185764.223784:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+41:12265:x1876096879508224:12345-192.168.204.48@tcp:101:cat.0 00010000:00010000:1.0:1789185764.223818:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185764.223858:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52024 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.224067:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.224085:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.224099:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185764.224113:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789185764.224264:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52024 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.224287:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52024 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.224297:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185764.224301:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185764.224306:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1e00, rc 0) 00000100:00100000:1.0:1789185764.224389:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+43:12265:x1876096879508224:12345-192.168.204.48@tcp:101:cat.0 Request processed in 609us (1072us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789185764.224397:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 166 00000100:00100000:0.0:1789185764.228678:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185764.228785:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879508352 00000100:00100000:1.0:1789185764.228799:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879508352 00000100:00100000:1.0:1789185764.228895:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:1.0:1789185764.228939:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+43:2391:x1876096879508352:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185764.228960:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185764.229015:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52024 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.229041:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185764.229047:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185764.229137:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+42:2391:x1876096879508352:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 230us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185764.229145:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:0.0:1789185764.232985:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185764.233198:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879508608 00000100:00100000:3.0:1789185764.233211:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879508608 00000100:00100000:3.0:1789185764.233382:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:3.0:1789185764.233395:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+42:12265:x1876096879508608:12345-192.168.204.48@tcp:35:cat.0 00000100:00100000:3.0:1789185764.233769:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+43:12265:x1876096879508608:12345-192.168.204.48@tcp:35:cat.0 Request processed in 377us (799us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789185764.233779:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:3.0:1789185764.302249:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185764.303347:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879508864 00000100:00100000:1.0:1789185764.303365:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879508864 00000100:00100000:1.0:1789185764.303649:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 167 00000100:00100000:1.0:1789185764.303664:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+43:12271:x1876096879508864:12345-192.168.204.48@tcp:101:dd.0 00010000:00010000:1.0:1789185764.303699:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185764.303703:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789185764.303740:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73836 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ffa expref: 43 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.303766:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185764.303774:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185764.303790:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738de lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5202b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.303984:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.303999:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5201d expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.304031:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.304071:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5201d expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.304086:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5201d expref: 43 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185764.304102:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898456320:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185764.305223:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185764.309116:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185764.310827:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879508992 00000100:00100000:2.0:1789185764.310847:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879508992 00010000:00010000:2.0:1789185764.311102:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5201d expref: 44 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185764.311162:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 82 00000100:00100000:2.0:1789185764.311184:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+44:2391:x1876096879508992:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185764.311200:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185764.311208:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5201d expref: 44 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.311221:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5201d expref: 44 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.311245:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185764.311251:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.311275:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.311283:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185764.311307:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185764.311385:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+44:2391:x1876096879508992:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 213us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185764.311405:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 82 00010000:00010000:1.0:1789185764.316519:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a738b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5201d expref: 43 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185764.316624:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898456320:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185764.316764:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.316779:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.316786:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185764.316819:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789185764.320024:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a738de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5202b expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.320096:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5202b expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.320107:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185764.320111:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789185764.320116:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1800, rc 0) 00000100:00100000:1.0:1789185764.320224:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+43:12271:x1876096879508864:12345-192.168.204.48@tcp:101:dd.0 Request processed in 16562us (17988us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789185764.320235:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 167 00000100:00100000:3.0:1789185764.335404:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185764.338382:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879509120 00000100:00100000:0.0:1789185764.338398:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879509120 00000100:00100000:0.0:1789185764.338501:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 168 00000100:00100000:0.0:1789185764.338512:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+43:12271:x1876096879509120:12345-192.168.204.48@tcp:101:dd.0 00010000:00010000:0.0:1789185764.338540:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185764.338824:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a738f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52032 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.338862:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.338877:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.338889:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.339069:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a738f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52032 expref: 45 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.339092:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52032 expref: 44 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.339102:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:0.0:1789185764.339105:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789185764.339110:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db600, rc 0) 00000100:00100000:0.0:1789185764.339179:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+44:12271:x1876096879509120:12345-192.168.204.48@tcp:101:dd.0 Request processed in 668us (3786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185764.339187:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 168 00000100:00100000:3.0:1789185764.346205:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185764.346614:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879509376 00000100:00100000:1.0:1789185764.346625:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879509376 00000100:00100000:1.0:1789185764.346689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 169 00000100:00100000:1.0:1789185764.346700:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+44:12271:x1876096879509376:12345-192.168.204.48@tcp:36:dd.0 00010000:00010000:1.0:1789185764.347086:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.347105:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.347118:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185764.347160:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1789185764.347183:0:6512:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000c7db979 reply state 00000000d7204437 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.347194:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.347216:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185764.347219:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789185764.347223:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185764.347326:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+47:12271:x1876096879509376:12345-192.168.204.48@tcp:36:dd.0 Request processed in 627us (1130us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789185764.347334:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 169 00000020:00080000:1.0:1789185764.347339:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789185764.646134:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185764.750028:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185764.750139:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879509504 00000100:00100000:1.0:1789185764.750148:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879509504 00000100:00100000:1.0:1789185764.750207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 170 00000100:00100000:1.0:1789185764.750218:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+47:12285:x1876096879509504:12345-192.168.204.48@tcp:101:stat.0 00010000:00010000:1.0:1789185764.750242:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185764.750263:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73908 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52039 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750325:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750338:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750349:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750359:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750366:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750389:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750479:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750491:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5202b expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750499:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750551:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5202b expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.750566:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5202b expref: 48 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185764.750579:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898456448:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185764.751200:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185764.754368:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898456448:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185764.754398:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185764.755284:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185764.755381:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879509760 00000100:00100000:2.0:1789185764.755388:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879509760 00000100:00100000:2.0:1789185764.755444:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 43 00000100:00100000:2.0:1789185764.755454:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+49:6160:x1876096879509760:12345-192.168.204.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789185764.755755:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+50:6160:x1876096879509760:12345-192.168.204.48@tcp:35:ldlm_bl.0 Request processed in 301us (475us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789185764.755768:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 43 00000100:00100000:3.0:1789185764.758393:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185764.758567:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879509888 00000100:00100000:1.0:1789185764.758577:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879509888 00010000:00010000:1.0:1789185764.758627:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5202b expref: 50 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185764.758690:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 83 00000100:00100000:1.0:1789185764.758701:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+50:2392:x1876096879509888:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185764.758715:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185764.758723:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5202b expref: 50 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.758735:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5202b expref: 50 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.758756:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a738e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5202b expref: 50 pid: 6513 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.758771:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185764.758776:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.758786:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.758793:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185764.758825:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185764.758879:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+49:2392:x1876096879509888:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 180us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185764.758886:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 83 00010000:00010000:3.0:1789185764.762192:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762211:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185764.762292:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789185764.762298:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789185764.762321:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762336:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762347:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762353:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762361:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762366:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185764.762371:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762378:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762393:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:3.0:1789185764.762396:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185764.762401:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762407:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a7390f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762432:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762438:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762445:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762450:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185764.762453:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762459:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762467:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2c4f8d100) 00010000:00010000:3.0:1789185764.762469:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185764.762472:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762477:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73916 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762515:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73908 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52039 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762556:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52039 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185764.762574:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185764.762578:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185764.762581:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0200, rc 0) 00000100:00100000:3.0:1789185764.762662:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+48:12285:x1876096879509504:12345-192.168.204.48@tcp:101:stat.0 Request processed in 12445us (12640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185764.762671:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 170 00000100:00100000:3.0:1789185764.889138:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185764.889370:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879510144 00000100:00100000:0.0:1789185764.889381:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879510144 00000100:00100000:0.0:1789185764.889452:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 171 00000100:00100000:0.0:1789185764.889462:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+48:12291:x1876096879510144:12345-192.168.204.48@tcp:36:truncate.0 00010000:00010000:0.0:1789185764.889531:0:8147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185764.889573:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7391d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52039 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.889593:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:0.0:1789185764.889599:0:8147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185764.889771:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.889786:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.889810:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185764.889854:0:8147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1789185764.889877:0:8147:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000002d3033d reply state 00000000c789ad45 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.889889:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185764.889896:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:0.0:1789185764.889899:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789185764.889902:0:8147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185764.890060:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+50:12291:x1876096879510144:12345-192.168.204.48@tcp:36:truncate.0 Request processed in 598us (932us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789185764.890069:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 171 00000020:00080000:0.0:1789185764.890073:0:8147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789185765.177518:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185765.178596:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879510272 00000100:00100000:1.0:1789185765.178628:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879510272 00000100:00100000:1.0:1789185765.178725:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 172 00000100:00100000:1.0:1789185765.178738:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+50:12305:x1876096879510272:12345-192.168.204.48@tcp:101:stat.0 00010000:00010000:1.0:1789185765.178763:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185765.178784:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0800/0xda5c730d5a7392b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.178849:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.178862:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.178873:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.178883:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.178890:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.178896:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.178996:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179005:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179012:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185765.179060:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789185765.179064:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185765.179083:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179094:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179101:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179107:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179114:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179120:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185765.179124:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179132:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179142:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185765.179144:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185765.179149:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179155:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a73932 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179177:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179182:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179188:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179193:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1c00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185765.179195:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179202:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179209:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2c4f8d100) 00010000:00010000:1.0:1789185765.179211:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185765.179214:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179220:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179246:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0800/0xda5c730d5a7392b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52040 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179259:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52040 expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.179276:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185765.179278:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185765.179281:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0c00, rc 0) 00000100:00100000:1.0:1789185765.179360:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+51:12305:x1876096879510272:12345-192.168.204.48@tcp:101:stat.0 Request processed in 625us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185765.179366:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 172 00000100:00080000:2.0:1789185765.179857:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185765.286740:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.286809:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879510528 00000100:00100000:3.0:1789185765.286820:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879510528 00000100:00100000:3.0:1789185765.286884:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 173 00000100:00100000:3.0:1789185765.286896:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+51:12315:x1876096879510528:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185765.286946:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185765.286968:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52047 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185765.287068:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789185765.287167:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73947 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52047 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.287180:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2700) 00010000:00010000:3.0:1789185765.287183:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185765.287189:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52047 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.287330:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dba00, rc 0) 00000100:00100000:3.0:1789185765.287391:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+52:12315:x1876096879510528:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 497us (662us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1789185765.287413:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 173 00000100:00100000:0.0:1789185765.290840:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.290951:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879510784 00000100:00100000:3.0:1789185765.290962:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879510784 00000100:00100000:3.0:1789185765.291028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 44 00000100:00100000:3.0:1789185765.291038:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6595450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+52:12315:x1876096879510784:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185765.291280:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6595450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+53:12315:x1876096879510784:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 242us (449us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789185765.291288:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 44 00000100:00100000:2.0:1789185765.291943:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185765.292728:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898456576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185765.292785:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185765.292972:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898456576 00000100:00100000:3.0:1789185765.292980:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898456576 00000100:00100000:3.0:1789185765.293066:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789185765.293076:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898456576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185765.293113:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789185765.293172:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898456576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185765.293189:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789185765.293265:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898456576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185765.439375:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.439467:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879511040 00000100:00100000:3.0:1789185765.439477:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879511040 00000100:00100000:3.0:1789185765.439561:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 174 00000100:00100000:3.0:1789185765.439572:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+53:12321:x1876096879511040:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185765.439606:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185765.439632:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73955 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5204e expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.439750:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.439779:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52040 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.439788:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.439822:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52040 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.439836:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52040 expref: 54 pid: 6512 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185765.439849:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff982a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898456704:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185765.439983:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c514c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789185765.455883:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185765.456003:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879511168 00000100:00100000:2.0:1789185765.456014:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879511168 00010000:00010000:2.0:1789185765.456057:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52040 expref: 55 pid: 6512 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185765.456120:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 84 00000100:00100000:2.0:1789185765.456129:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+55:2391:x1876096879511168:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185765.456144:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185765.456151:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52040 expref: 55 pid: 6512 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.456164:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52040 expref: 55 pid: 6512 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.456209:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185765.456214:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.456225:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.456232:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.456253:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185765.456545:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73940 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52040 expref: 55 pid: 6512 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185765.456563:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff982a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898456704:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185765.456757:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+54:2391:x1876096879511168:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 628us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185765.456766:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 84 00010000:00010000:3.0:1789185765.465565:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.465693:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.465702:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185765.465743:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789185765.465888:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73955 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5204e expref: 55 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.465934:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5204e expref: 54 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.465944:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185765.465946:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789185765.465950:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db400, rc 0) 00000100:00100000:2.0:1789185765.466024:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+54:12321:x1876096879511040:12345-192.168.204.48@tcp:101:bash.0 Request processed in 26453us (26660us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789185765.466033:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 174 00000100:00100000:0.0:1789185765.470960:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.471055:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879511424 00000100:00100000:3.0:1789185765.471067:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879511424 00000100:00100000:3.0:1789185765.471118:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 175 00000100:00100000:3.0:1789185765.471128:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+54:12321:x1876096879511424:12345-192.168.204.48@tcp:36:bash.0 00010000:00010000:3.0:1789185765.471393:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.471415:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.471428:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185765.471475:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789185765.471496:0:6514:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000067eb3b36 reply state 00000000dfd6aee2 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.471508:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.471515:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185765.471518:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185765.471533:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185765.471627:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+57:12321:x1876096879511424:12345-192.168.204.48@tcp:36:bash.0 Request processed in 500us (719us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789185765.471634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 175 00000020:00080000:3.0:1789185765.471640:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789185765.478732:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.481853:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879511552 00000100:00100000:3.0:1789185765.481867:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879511552 00000100:00100000:0.0:1789185765.487550:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 176 00000100:00100000:0.0:1789185765.487567:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+57:12321:x1876096879511552:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185765.487602:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185765.487624:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73971 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52055 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185765.487736:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185765.487751:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5204e expref: 58 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185765.487760:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185765.487794:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5204e expref: 58 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185765.487807:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5204e expref: 58 pid: 9473 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185765.487821:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898456832:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185765.487944:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e05f7840 going to sleep for 11 seconds 00000100:00100000:0.0:1789185765.496034:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185765.496106:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879511680 00000100:00100000:2.0:1789185765.496116:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879511680 00010000:00010000:2.0:1789185765.496155:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5204e expref: 59 pid: 9473 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185765.496212:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 85 00000100:00100000:2.0:1789185765.496223:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+59:2392:x1876096879511680:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185765.496237:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185765.496244:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5204e expref: 59 pid: 9473 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.496256:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5204e expref: 59 pid: 9473 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.496300:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185765.496305:0:10394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.496314:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.496321:0:10394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.496340:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185765.496397:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+59:2392:x1876096879511680:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 175us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185765.496404:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 85 00010000:00010000:1.0:1789185765.498740:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a7395c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5204e expref: 58 pid: 9473 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185765.498766:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898456832:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185765.498791:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.498801:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.498807:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185765.498861:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789185765.498865:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185765.498885:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.498985:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73971 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52055 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.499002:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52055 expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.499027:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185765.499030:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185765.499034:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dac00, rc 0) 00000100:00100000:1.0:1789185765.499100:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+57:12321:x1876096879511552:12345-192.168.204.48@tcp:101:bash.0 Request processed in 11537us (20378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185765.499109:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 176 00000100:00100000:0.0:1789185765.506662:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.506814:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879511936 00000100:00100000:3.0:1789185765.506826:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879511936 00000100:00100000:3.0:1789185765.506887:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 45 00000100:00100000:3.0:1789185765.506898:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+57:12321:x1876096879511936:12345-192.168.204.48@tcp:35:bash.0 00000100:00100000:3.0:1789185765.507146:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+58:12321:x1876096879511936:12345-192.168.204.48@tcp:35:bash.0 Request processed in 250us (493us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789185765.507154:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 45 00000100:00100000:2.0:1789185765.627634:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185765.627747:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879512192 00000100:00100000:0.0:1789185765.627758:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879512192 00000100:00100000:0.0:1789185765.627823:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 177 00000100:00100000:0.0:1789185765.627834:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+58:12331:x1876096879512192:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185765.627857:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185765.627877:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7397f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5205c expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185765.628087:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789185765.628187:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7397f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5205c expref: 60 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185765.628202:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2700) 00010000:00010000:0.0:1789185765.628205:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185765.628210:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a7397f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5205c expref: 60 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185765.628224:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db800, rc 0) 00000100:00100000:0.0:1789185765.628278:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+59:12331:x1876096879512192:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 446us (655us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1789185765.628285:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 177 00000100:00100000:0.0:1789185765.646358:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.646455:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879512320 00000100:00100000:3.0:1789185765.646465:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879512320 00000100:00100000:3.0:1789185765.646537:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 178 00000100:00100000:3.0:1789185765.646547:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+59:12331:x1876096879512320:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:3.0:1789185765.646640:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646656:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646667:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646680:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646686:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646692:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646767:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646777:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646784:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185765.646833:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646859:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646865:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646872:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646878:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185765.646882:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646890:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646903:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:3.0:1789185765.646948:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185765.646954:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646961:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a7398d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646974:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646980:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646986:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.646998:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185765.647001:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647007:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647015:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2c4f8d100) 00010000:00010000:3.0:1789185765.647017:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185765.647020:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647026:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73994 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647037:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647043:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647049:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647054:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185765.647056:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647062:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647079:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185765.647082:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185765.647085:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.647090:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a7399b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185765.647161:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+59:12331:x1876096879512320:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 615us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185765.647169:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 178 00000100:00100000:1.0:1789185765.651341:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.651427:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879512576 00000100:00100000:3.0:1789185765.651437:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879512576 00000100:00100000:3.0:1789185765.651497:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 46 00000100:00100000:3.0:1789185765.651508:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+59:12331:x1876096879512576:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185765.651762:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+60:12331:x1876096879512576:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 255us (429us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789185765.651770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 46 00010000:00010000:2.0:1789185765.670261:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185765.730779:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185765.730946:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879512832 00000100:00100000:1.0:1789185765.730956:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879512832 00000100:00100000:1.0:1789185765.731017:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 179 00000100:00100000:1.0:1789185765.731028:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+60:12334:x1876096879512832:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185765.731053:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185765.731076:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a739a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731148:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731162:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731173:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731602:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731611:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731634:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731744:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0800/0xda5c730d5a739b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731754:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0800/0xda5c730d5a739b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731762:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0800/0xda5c730d5a739b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185765.731772:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789185765.731856:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731864:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731871:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731876:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1c00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185765.731881:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731889:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731900:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185765.731904:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185765.731969:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731976:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a739a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731990:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.731996:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.732000:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.732005:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0c00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185765.732007:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.732013:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.732020:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2c4f8d100) 00010000:00010000:1.0:1789185765.732022:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185765.732025:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.732030:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a739b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.732088:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a739a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52063 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.732112:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0800/0xda5c730d5a739b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52063 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185765.732126:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185765.732128:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185765.732131:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0800, rc 0) 00000100:00100000:1.0:1789185765.732875:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+62:12334:x1876096879512832:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1844us (2100us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789185765.732885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 179 00000100:00100000:0.0:1789185765.751272:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185765.751436:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879512960 00000100:00100000:2.0:1789185765.751447:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879512960 00000100:00100000:2.0:1789185765.751512:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:2.0:1789185765.751537:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+62:2389:x1876096879512960:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185765.751553:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185765.751578:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0800/0xda5c730d5a739b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52063 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185765.751597:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185765.751602:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185765.751675:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+61:2389:x1876096879512960:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 141us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185765.751684:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:0.0:1789185765.767309:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.767701:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879513088 00000100:00100000:3.0:1789185765.767713:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879513088 00000100:00100000:3.0:1789185765.767812:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 180 00000100:00100000:3.0:1789185765.767823:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+61:12334:x1876096879513088:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:3.0:1789185765.767891:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.767938:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.767968:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.768005:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.768011:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.768018:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.768024:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185765.768029:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.768036:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.768047:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185765.768050:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185765.768056:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185765.768061:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185765.768150:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+61:12334:x1876096879513088:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 328us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185765.768158:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 180 00000100:00100000:0.0:1789185765.771157:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185765.771244:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879513344 00000100:00100000:3.0:1789185765.771267:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879513344 00000100:00100000:3.0:1789185765.771326:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 47 00000100:00100000:3.0:1789185765.771336:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+61:12334:x1876096879513344:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185765.771573:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+62:12334:x1876096879513344:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 238us (425us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789185765.771581:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 47 00000100:00100000:3.0:1789185766.006233:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185766.006463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879513600 00000100:00100000:0.0:1789185766.006474:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879513600 00000100:00100000:0.0:1789185766.006544:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 181 00000100:00100000:0.0:1789185766.006555:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+62:12352:x1876096879513600:12345-192.168.204.48@tcp:101:cat.0 00010000:00010000:0.0:1789185766.006580:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185766.006602:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a739cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5206a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.006714:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a739d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.006743:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a739d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.006757:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a739d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185766.006770:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789185766.006878:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a739cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5206a expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.006897:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a739d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5206a expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.006905:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:0.0:1789185766.006974:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789185766.006978:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db800, rc 0) 00000100:00100000:0.0:1789185766.007044:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+64:12352:x1876096879513600:12345-192.168.204.48@tcp:101:cat.0 Request processed in 490us (820us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789185766.007051:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 181 00000100:00100000:1.0:1789185766.042669:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185766.042872:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879513728 00000100:00100000:0.0:1789185766.042882:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879513728 00000100:00100000:0.0:1789185766.043010:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 182 00000100:00100000:0.0:1789185766.043021:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+64:12353:x1876096879513728:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185766.043045:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185766.043067:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a739e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52071 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.043165:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a739e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.043193:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a739e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.043205:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a739e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185766.043259:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789185766.043263:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185766.043856:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a739e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.043889:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a739e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52071 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.043963:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a739e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52071 expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185766.043973:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:0.0:1789185766.043976:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185766.043980:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0030800, rc 0) 00000100:00100000:0.0:1789185766.044167:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+65:12353:x1876096879513728:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1147us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185766.044175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 182 00000100:00100000:3.0:1789185766.057265:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185766.057859:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879514112 00000100:00100000:0.0:1789185766.057871:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879514112 00000100:00100000:0.0:1789185766.057997:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 48 00000100:00100000:0.0:1789185766.058009:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+65:12353:x1876096879514112:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:0.0:1789185766.058307:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12353:x1876096879514112:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 300us (1052us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789185766.058315:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 48 00000100:00100000:1.0:1789185766.065240:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185766.065407:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879514240 00000100:00100000:2.0:1789185766.065417:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879514240 00000100:00100000:2.0:1789185766.065484:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:2.0:1789185766.065493:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12353:x1876096879514240:12345-192.168.204.48@tcp:103:lfs.0 00010000:00010000:2.0:1789185766.065509:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789185766.065547:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73978 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52055 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.065572:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a739d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5206a expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.065586:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73875 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5200f expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.065596:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185766.065600:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185766.065666:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+63:12353:x1876096879514240:12345-192.168.204.48@tcp:103:lfs.0 Request processed in 173us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185766.065673:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:1.0:1789185766.068207:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185766.068291:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879514368 00000100:00100000:3.0:1789185766.068302:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879514368 00000100:00100000:3.0:1789185766.068365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 183 00000100:00100000:3.0:1789185766.068375:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+63:12353:x1876096879514368:12345-192.168.204.48@tcp:58:lfs.0 00010000:00010000:3.0:1789185766.068506:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.068535:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.068547:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185766.068651:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789185766.068731:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+63:12353:x1876096879514368:12345-192.168.204.48@tcp:58:lfs.0 Request processed in 357us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185766.068739:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 183 00000100:00100000:0.0:1789185766.101445:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185766.101801:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879514496 00000100:00100000:2.0:1789185766.101812:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879514496 00000100:00100000:2.0:1789185766.101939:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 184 00000100:00100000:2.0:1789185766.101951:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+63:12355:x1876096879514496:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185766.101974:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185766.102010:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a739f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52078 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102076:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102091:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102103:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102113:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102121:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102128:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102232:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102243:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102371:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185766.102416:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789185766.102420:0:9473:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185766.102438:0:9473:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102458:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102467:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102475:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102482:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102489:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185766.102493:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102501:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102698:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185766.102703:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185766.102709:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102716:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a739fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102741:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102748:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102764:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102769:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185766.102772:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102777:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102785:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2c4f8d100) 00010000:00010000:2.0:1789185766.102787:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185766.102790:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102795:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73a04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102822:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a739f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52078 expref: 65 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102836:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52078 expref: 64 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.102843:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185766.102845:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185766.102848:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402fc00, rc 0) 00000100:00100000:2.0:1789185766.102972:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+64:12355:x1876096879514496:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1022us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185766.102990:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 184 00000100:00100000:0.0:1789185766.310085:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898456960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185766.310163:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185766.310240:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898456960 00000100:00100000:0.0:1789185766.310247:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898456960 00000100:00100000:0.0:1789185766.310303:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789185766.310313:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898456960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185766.310345:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789185766.310391:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898456960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185766.310398:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1789185766.310420:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185766.310453:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898456960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185766.311010:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898457088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185766.311046:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185766.311262:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898457088 00000100:00100000:3.0:1789185766.311267:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898457088 00000100:00100000:3.0:1789185766.311318:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789185766.311326:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898457088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789185766.311355:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789185766.311395:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898457088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185766.311401:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1789185766.311457:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185766.311481:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898457088:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789185766.695111:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789185766.835799:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:0.0:1789185766.835856:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789185766.835884:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f1c22aa540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789185766.835899:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f3002bab00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f1c22aa480 00000020:00080000:0.0:1789185766.835903:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f3002ba000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f2d284f200 00000020:00080000:0.0:1789185766.835971:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789185766.836033:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789185766.836180:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836194:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836202:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836208:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185766.836213:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836222:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836240:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98f2c4f8d200) 00010000:00010000:3.0:1789185766.836244:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185766.836249:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836255:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a737b8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836278:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836295:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836301:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836306:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185766.836309:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836314:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836322:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:3.0:1789185766.836324:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185766.836327:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836332:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a737bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836348:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836353:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836359:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836364:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185766.836372:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836378:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836388:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2c4f8d100) 00010000:00010000:3.0:1789185766.836390:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185766.836393:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836400:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c800/0xda5c730d5a737fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836419:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836426:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836433:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836439:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185766.836442:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836449:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836456:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185766.836458:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185766.836468:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836474:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73901 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836487:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836493:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836514:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836519:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185766.836522:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836528:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836538:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185766.836540:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185766.836543:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836549:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73924 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185766.836561:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789185766.836562:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836571:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185766.836582:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898457216:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789185766.836585:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836593:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185766.836595:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836603:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836611:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185766.836613:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185766.836616:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.836622:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a7396a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185766.836673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185766.836865:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898457216 00000100:00100000:3.0:1789185766.836872:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898457216 00000100:00100000:3.0:1789185766.836969:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789185766.836980:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898457216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789185766.837008:0:9819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1789185766.837039:0:9819:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4cee3, atime: 0x6aa4cee3, ctime: 0x6aa4cee3, blocks: 0x8 00010000:00010000:3.0:1789185766.837047:0:9819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.837061:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=405s v=(0 0) 00010000:00010000:3.0:1789185766.837066:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185766.837080:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.837097:0:9819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.837106:0:9819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.837113:0:9819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185766.837141:0:9819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789185766.837411:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898457216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 433us (738us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789185766.837419:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1789185766.837480:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185766.837488:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.837508:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185766.837513:0:9518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.837523:0:9518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.837537:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.837544:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a73a12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185766.837558:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185766.837560:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185766.837561:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789185766.838308:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f1c41e9f80/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789185766.838319:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898457216:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1789185766.838666:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789185767.079207:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789185767.079217:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185767.079525:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789185767.079534:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789185767.079675:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ea680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898457344:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789185767.081391:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076780 going to sleep for 11 seconds 00000100:00100000:0.0:1789185767.094206:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185767.094250:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879514624 00000100:00100000:0.0:1789185767.094259:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879514624 00000100:00100000:0.0:1789185767.094336:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 185 00000100:00100000:0.0:1789185767.094346:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12366:x1876096879514624:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789185767.094376:0:6513:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789185767.094645:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12366:x1876096879514624:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 299us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185767.094653:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 185 00000100:00080000:0.0:1789185767.094678:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185767.095190:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ea680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898457344:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185767.108990:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185767.109073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879514752 00000100:00100000:0.0:1789185767.109083:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879514752 00000100:00100000:0.0:1789185767.109146:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 186 00000100:00100000:0.0:1789185767.109157:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+17:12366:x1876096879514752:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789185767.109234:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109263:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109279:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109426:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109435:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109442:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109472:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109480:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109486:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185767.109827:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789185767.109832:0:6512:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185767.109845:0:6512:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109858:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109865:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109871:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109886:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185767.109890:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109897:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109935:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:0.0:1789185767.109939:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185767.109944:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109950:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030400/0xda5c730d5a73a19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109964:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109969:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109975:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109980:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185767.109983:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.109990:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.110008:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff98f1c33e2300) 00010000:00010000:0.0:1789185767.110011:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185767.110014:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.110020:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031e00/0xda5c730d5a73a20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.110035:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.110041:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.110047:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.110052:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185767.110054:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.110061:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.110068:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:0.0:1789185767.110070:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185767.110072:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.110078:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185767.110172:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+17:12366:x1876096879514752:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 Request processed in 1015us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185767.110180:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 186 00000100:00100000:3.0:1789185767.122746:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185767.127621:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879515008 00000100:00100000:2.0:1789185767.127638:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879515008 00000100:00100000:2.0:1789185767.127709:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 187 00000100:00100000:2.0:1789185767.127731:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+17:12366:x1876096879515008:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185767.127755:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185767.127777:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5207f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.127891:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.127939:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.127952:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185767.127963:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789185767.128055:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.128062:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.128069:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.128075:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185767.128081:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.128088:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.128101:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185767.128110:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185767.128116:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.128122:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.128163:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a2e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5207f expref: 19 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.128173:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:2.0:1789185767.128175:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185767.128179:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5207f expref: 19 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.128188:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f600, rc 0) 00000100:00100000:2.0:1789185767.128267:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12366:x1876096879515008:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 539us (5530us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1789185767.128275:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 187 00000040:00080000:0.0:1789185767.149190:0:14667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185767.149200:0:14667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185767.149224:0:14667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789185767.150535:0:14667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789185767.152900:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.154340:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879515136 00000100:00100000:3.0:1789185767.154355:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879515136 00000100:00100000:3.0:1789185767.154431:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 188 00000100:00100000:3.0:1789185767.154443:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12366:x1876096879515136:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789185767.154478:0:6514:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789185767.154618:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12366:x1876096879515136:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 177us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185767.154626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 188 00000100:00100000:1.0:1789185767.163126:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185767.163244:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879515392 00000100:00100000:0.0:1789185767.163255:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879515392 00000100:00100000:0.0:1789185767.163310:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 189 00000100:00100000:0.0:1789185767.163321:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12366:x1876096879515392:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185767.163341:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185767.163344:0:8147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789185767.163370:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a739e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52071 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.163387:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:0.0:1789185767.163392:0:8147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185767.163405:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a43 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52086 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789185767.163828:0:8147:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789185767.164006:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73a4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.164022:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.164045:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.164105:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73a43 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52086 expref: 20 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.164122:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52086 expref: 19 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.164129:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:0.0:1789185767.164132:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185767.164134:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db800, rc 0) 00000100:00100000:0.0:1789185767.164193:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+19:12366:x1876096879515392:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 874us (1079us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789185767.164200:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 189 00000100:00100000:1.0:1789185767.175148:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185767.175474:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879515648 00000100:00100000:2.0:1789185767.175484:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879515648 00000100:00100000:2.0:1789185767.175631:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 190 00000100:00100000:2.0:1789185767.175642:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+19:12366:x1876096879515648:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185767.175700:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185767.175731:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73a4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52086 expref: 19 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.175748:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f1c33e2300) 00010000:00010000:2.0:1789185767.175772:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185767.175801:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.175814:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.175825:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.175841:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.175847:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.175853:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.175899:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177077:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177091:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177097:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185767.177102:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177111:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177131:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185767.177134:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185767.177139:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177144:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73a58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177156:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177162:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177168:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177173:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185767.177175:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177181:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177187:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc37f28c8 (ffff98f2d2ed4a00) 00010000:00010000:2.0:1789185767.177189:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185767.177192:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.177198:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a5f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc37f28c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185767.177603:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12366:x1876096879515648:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 1959us (2461us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185767.177613:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 190 00000100:00100000:2.0:1789185767.183971:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185767.184128:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879515776 00000100:00100000:1.0:1789185767.184139:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879515776 00000100:00100000:1.0:1789185767.184210:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 191 00000100:00100000:1.0:1789185767.184221:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12366:x1876096879515776:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185767.184245:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185767.184268:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73a66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5208d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.184304:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.184318:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.184330:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.184441:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73a66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5208d expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.184459:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5208d expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.184468:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:1.0:1789185767.184471:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185767.184475:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0600, rc 0) 00000100:00100000:1.0:1789185767.184566:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+19:12366:x1876096879515776:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 347us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185767.184574:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 191 00000100:00100000:0.0:1789185767.203960:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185767.204152:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879516032 00000100:00100000:2.0:1789185767.204164:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879516032 00000100:00100000:2.0:1789185767.204223:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 192 00000100:00100000:2.0:1789185767.204235:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+19:12366:x1876096879516032:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185767.204322:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.204340:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.204352:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185767.204548:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789185767.204558:0:9473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406366649748ns, next at 407366647411ns, rc = 0 00000004:00010000:2.0:1789185767.204610:0:9473:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e905a13f reply state 00000000d349081d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.204624:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.204631:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:2.0:1789185767.204634:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789185767.204639:0:9473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185767.204757:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+21:12366:x1876096879516032:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 524us (808us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789185767.204765:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 192 00000100:00100000:2.0:1789185767.212308:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.212572:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879516160 00000100:00100000:3.0:1789185767.212583:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879516160 00000100:00100000:3.0:1789185767.212668:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 193 00000100:00100000:3.0:1789185767.212678:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:12366:x1876096879516160:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185767.212704:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185767.212724:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52094 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.212785:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52094 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.212802:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52094 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.212820:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:3.0:1789185767.212823:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185767.212827:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dac00, rc 0) 00000100:00100000:3.0:1789185767.212887:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:12366:x1876096879516160:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 210us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185767.212894:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 193 00000100:00100000:2.0:1789185767.220456:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.221340:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879516288 00000100:00100000:3.0:1789185767.221352:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879516288 00000100:00100000:3.0:1789185767.221435:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:3.0:1789185767.221446:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2391:x1876096879516288:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789185767.221701:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879516288:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 256us (1254us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789185767.221710:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00080000:0.0:1789185767.222637:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185767.231698:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185767.231897:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879516544 00000100:00100000:0.0:1789185767.231930:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879516544 00000100:00100000:0.0:1789185767.231995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 49 00000100:00100000:0.0:1789185767.232732:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:12366:x1876096879516544:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789185767.232991:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+23:12366:x1876096879516544:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 986us (1302us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1789185767.234866:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 49 00000100:00100000:2.0:1789185767.261506:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185767.261702:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879516800 00000100:00100000:0.0:1789185767.261713:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879516800 00000100:00100000:0.0:1789185767.261791:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 194 00000100:00100000:0.0:1789185767.261802:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+23:12366:x1876096879516800:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789185767.261945:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+23:12366:x1876096879516800:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 145us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185767.261954:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 194 00000100:00100000:2.0:1789185767.269448:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.269535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879516928 00000100:00100000:3.0:1789185767.269558:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879516928 00000100:00100000:3.0:1789185767.269622:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 195 00000100:00100000:3.0:1789185767.269631:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+23:12366:x1876096879516928:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185767.269651:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185767.269671:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5209b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.269737:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73a89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.269751:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.269762:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185767.269807:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789185767.269825:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73a89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.269849:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5209b expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.269865:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73a89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5209b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.269873:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:3.0:1789185767.269877:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789185767.269881:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185767.269957:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12366:x1876096879516928:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 326us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185767.269969:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 195 00000100:00100000:3.0:1789185767.281555:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185767.282237:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879517056 00000100:00100000:1.0:1789185767.282248:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879517056 00000100:00100000:1.0:1789185767.282316:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:1.0:1789185767.282326:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879517056:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185767.282346:0:9819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185767.282368:0:9819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520a2 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185767.282394:0:9819:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4cee7, blocks: 0x0 00010000:00010000:1.0:1789185767.282414:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1789185767.282419:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185767.282427:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a2 expref: 8 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.282445:0:9819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a2 expref: 8 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.282457:0:9819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0a00, rc 0) 00000100:00100000:1.0:1789185767.283122:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879517056:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 794us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185767.283130:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:0.0:1789185767.299433:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185767.299514:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879517312 00000100:00100000:1.0:1789185767.299524:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879517312 00000100:00100000:1.0:1789185767.299586:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 196 00000100:00100000:1.0:1789185767.299596:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12366:x1876096879517312:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789185767.299708:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12366:x1876096879517312:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185767.299715:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 196 00000100:00100000:2.0:1789185767.308434:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.308662:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879517440 00000100:00100000:3.0:1789185767.308672:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879517440 00000100:00100000:3.0:1789185767.308733:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:3.0:1789185767.308745:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:12366:x1876096879517440:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185767.308765:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185767.308782:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520a9 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.308816:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a2 expref: 9 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.308825:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185767.308830:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185767.308835:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.308871:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a2 expref: 9 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.308885:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a2 expref: 9 pid: 9819 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.308898:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff981500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876096898457472:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185767.310182:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185767.313948:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff981500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876096898457472:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185767.313997:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185767.314264:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185767.314570:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879517568 00000100:00100000:0.0:1789185767.314578:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879517568 00010000:00010000:0.0:1789185767.314617:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a2 expref: 10 pid: 9819 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185767.314665:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 86 00000100:00100000:0.0:1789185767.314675:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2391:x1876096879517568:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185767.314690:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185767.314712:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a2 expref: 10 pid: 9819 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.314725:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a2 expref: 10 pid: 9819 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.314748:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd4e49c/0xda5c730d5a73a90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a2 expref: 10 pid: 9819 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.314765:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185767.314769:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185767.314778:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.314801:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.314837:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185767.314852:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1876096898457600:192.168.204.48@tcp:105: 00000100:00100000:0.0:1789185767.314951:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e05f76c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789185767.315322:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db600, rc 0) 00000100:00100000:3.0:1789185767.315355:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+9:12366:x1876096879517440:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 6612us (6932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185767.315363:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:0.0:1789185767.320291:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1876096898457600:192.168.204.48@tcp:105: 00010000:00010000:0.0:1789185767.320317:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185767.320381:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879517568:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 5706us (6118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185767.320392:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 86 00000100:00100000:0.0:1789185767.321564:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185767.321739:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879517696 00000100:00100000:2.0:1789185767.321749:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879517696 00002000:00100000:2.0:1789185767.321796:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff98f1c4152680 x1876096879517696/t0(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:368/0 lens 504/0 e 0 to 0 dl 1789185778 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185767.321808:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c4152680 with x1876096879517696 ext(0->8) 00002000:00010000:2.0:1789185767.321813:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c4152680 00000100:00100000:2.0:1789185767.321850:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:2.0:1789185767.321861:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879517696:12345-192.168.204.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789185767.324168:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2391:x1876096879517696:12345-192.168.204.48@tcp:4:lhsmtool_posix.0 Request processed in 2299us (2599us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789185767.324184:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 4 00002000:00100000:2.0:1789185767.324197:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff98f1c4152680 x1876096879517696/t4294967315(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:368/0 lens 504/448 e 0 to 0 dl 1789185778 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185767.324209:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c4152680 with x1876096879517696 ext(0->8) 00002000:00010000:2.0:1789185767.324215:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c4152680 00000100:00100000:2.0:1789185767.342015:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.342119:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879517824 00000100:00100000:3.0:1789185767.342129:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879517824 00000100:00100000:3.0:1789185767.342182:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 197 00000100:00100000:3.0:1789185767.342193:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12366:x1876096879517824:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789185767.344449:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789185767.344466:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789185767.344485:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:3.0:1789185767.344578:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.344592:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.344601:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.344607:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185767.344612:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.344619:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.344650:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:3.0:1789185767.344653:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789185767.344658:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.344665:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73a74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185767.344819:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185767.344836:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898457728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789185767.344896:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185767.344966:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898457728 00000100:00100000:0.0:1789185767.344985:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898457728 00000100:00100000:0.0:1789185767.345046:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789185767.345055:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898457728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789185767.345184:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789185767.345188:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789185767 00002000:00010000:0.0:1789185767.345190:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789185767.345198:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789185767 -> 1789185767 00002000:00010000:0.0:1789185767.345201:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789185767.345238:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898457728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (342us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789185767.345245:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1789185767.345285:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f1c4150e00/2, rc 0, transno 4294967316 00000100:00100000:0.0:1789185767.345291:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898457728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789185767.345756:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+19:12366:x1876096879517824:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 Request processed in 3562us (3749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185767.345766:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 197 00000020:00080000:0.0:1789185767.346339:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789185767.346352:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789185767.349265:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185767.351179:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879517952 00000100:00100000:1.0:1789185767.351195:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879517952 00000100:00100000:1.0:1789185767.351262:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 63 00000100:00100000:1.0:1789185767.351274:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2392:x1876096879517952:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789185767.357287:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1789185767.357304:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1789185767.357473:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879517952:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 Request processed in 6196us (8212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185767.357485:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 63 00000100:00100000:0.0:1789185767.364608:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.371035:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879518208 00000100:00100000:3.0:1789185767.371051:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879518208 00000100:00100000:3.0:1789185767.371117:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 198 00000100:00100000:3.0:1789185767.371128:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+19:12366:x1876096879518208:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789185767.371181:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185767.371208:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73a89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5209b expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.371226:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:3.0:1789185767.371231:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185767.371263:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.371277:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.371287:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185767.371427:0:6513:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002fda3bf6 reply state 000000007216e789 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.371440:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.371446:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:3.0:1789185767.371449:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185767.371452:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185767.372612:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+20:12366:x1876096879518208:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 1478us (8006us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1789185767.372623:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 198 00000100:00100000:0.0:1789185767.390271:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185767.392411:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879518336 00000100:00100000:1.0:1789185767.392426:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879518336 00000100:00100000:1.0:1789185767.392511:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 64 00000100:00100000:1.0:1789185767.392522:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879518336:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789185767.392723:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789185767.392726:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789185767 -> 1789185765 00002000:00010000:1.0:1789185767.392729:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789185763 00002000:00010000:1.0:1789185767.392731:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789185767 -> 1789185765 00002000:00010000:1.0:1789185767.392733:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789185767.393200:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879518336:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 678us (2937us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789185767.393209:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 64 00000100:00100000:0.0:1789185767.407841:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185767.409389:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879518592 00000100:00100000:1.0:1789185767.409405:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879518592 00000100:00100000:1.0:1789185767.409462:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 199 00000100:00100000:1.0:1789185767.409475:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+20:12366:x1876096879518592:12345-192.168.204.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789185767.409559:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.409577:0:8147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5208d expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.409600:0:8147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.409637:0:8147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5208d expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185767.409652:0:8147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5208d expref: 20 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185767.409667:0:8147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8147:1876096898457856:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185767.409771:0:8147:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076480 going to sleep for 11 seconds 00000100:00100000:2.0:1789185767.412663:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.412734:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879518720 00000100:00100000:3.0:1789185767.412744:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879518720 00010000:00010000:3.0:1789185767.412783:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5208d expref: 21 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.412826:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 87 00000100:00100000:3.0:1789185767.412835:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+21:2391:x1876096879518720:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185767.412849:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185767.412856:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5208d expref: 21 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.412870:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5208d expref: 21 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.412891:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:3.0:1789185767.412933:0:10394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.412945:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.412953:0:10394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.412985:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185767.414394:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73a6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5208d expref: 21 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185767.414416:0:8147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8147:1876096898457856:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185767.414455:0:8147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.414466:0:8147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.414472:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.414529:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.414537:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.414554:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.414560:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0a00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185767.414566:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.414574:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.414599:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:0.0:1789185767.414603:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789185767.414608:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.414615:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0a00/0xda5c730d5a73aa5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185767.414710:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+20:12366:x1876096879518592:12345-192.168.204.48@tcp:55:lhsmtool_posix.0 Request processed in 5237us (6879us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789185767.414721:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 199 00000100:00100000:3.0:1789185767.418601:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+19:2391:x1876096879518720:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 2142us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185767.418619:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 87 00000100:00100000:3.0:1789185767.423449:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185767.423781:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879518848 00000100:00100000:2.0:1789185767.423795:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879518848 00000100:00100000:2.0:1789185767.423860:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00100000:2.0:1789185767.423871:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879518848:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789185767.423941:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.423961:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.423969:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185767.424762:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185767.424768:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.424811:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.424828:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 8 pid: 8427 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185767.424856:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876096898457984:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185767.426269:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3000859c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185767.436146:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185767.436240:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876096898457984:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185767.436267:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.436660:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879518976 00000100:00100000:3.0:1789185767.436669:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879518976 00010000:00010000:3.0:1789185767.436707:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 9 pid: 8427 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.436761:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 88 00000100:00100000:3.0:1789185767.436772:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2392:x1876096879518976:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185767.436787:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185767.436810:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 9 pid: 8427 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.436823:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 9 pid: 8427 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.436848:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268e03d2/0xda5c730d5a73a97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520a9 expref: 9 pid: 8427 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.436879:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185767.436883:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185767.436889:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.436898:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.436941:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185767.437048:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.437060:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.437081:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.437091:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.437099:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.437106:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185767.437111:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.437134:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.437147:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.437155:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a73aac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.437317:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879518976:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 545us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185767.437319:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879518848:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 Request processed in 13447us (13879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185767.437338:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00100000:3.0:1789185767.437339:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 88 00000100:00100000:1.0:1789185767.447388:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.447467:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879519232 00000100:00100000:3.0:1789185767.447479:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879519232 00000100:00100000:3.0:1789185767.447549:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 200 00000100:00100000:3.0:1789185767.447561:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+19:12366:x1876096879519232:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789185767.447647:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.447663:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52032 expref: 19 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.447672:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.447708:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52032 expref: 19 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.447738:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52032 expref: 19 pid: 8147 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.447758:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898458112:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185767.447856:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1ba000 going to sleep for 11 seconds 00000100:00100000:3.0:1789185767.454479:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.454525:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879519360 00000100:00100000:3.0:1789185767.454536:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879519360 00010000:00010000:3.0:1789185767.457532:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52032 expref: 20 pid: 8147 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.457592:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 89 00000100:00100000:3.0:1789185767.457610:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+20:2392:x1876096879519360:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185767.457626:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185767.457633:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52032 expref: 20 pid: 8147 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.457647:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52032 expref: 20 pid: 8147 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.457669:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185767.457674:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.457684:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.457709:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.457729:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185767.457790:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+20:2392:x1876096879519360:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 189us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185767.457797:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 89 00010000:00010000:3.0:1789185767.457991:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a738fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52032 expref: 19 pid: 8147 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.458167:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898458112:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185767.458188:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.458197:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.458203:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.458381:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.458394:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52094 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.458402:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.458442:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52094 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.458456:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52094 expref: 19 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.458472:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898458240:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185767.458545:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185767.467840:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185767.468519:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879519488 00000100:00100000:2.0:1789185767.468531:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879519488 00010000:00010000:2.0:1789185767.468575:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52094 expref: 20 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185767.468618:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 90 00000100:00100000:2.0:1789185767.468629:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+20:2391:x1876096879519488:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185767.468647:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185767.468654:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52094 expref: 20 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.468667:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52094 expref: 20 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.468712:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:2.0:1789185767.468719:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.468731:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.468736:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73a7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52094 expref: 20 pid: 6513 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.468740:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.468761:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898458240:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185767.468770:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185767.468786:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.468797:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.468804:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185767.468885:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+19:2391:x1876096879519488:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 256us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185767.468894:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 90 00000001:00080000:3.0:1789185767.468951:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789185767.469741:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1789185767.469776:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789185767.469850:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898458368:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789185767.469947:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185767.469981:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f0f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185767.470074:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898458368 00000100:00100000:2.0:1789185767.470082:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898458368 00000100:00100000:2.0:1789185767.470137:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789185767.470148:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9473:x1876096898458368:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789185767.470246:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9473:x1876096898458368:12345-0@lo:1000:mdt00_004.0 Request processed in 100us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185767.470254:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789185767.470343:0:9473:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789185767.470351:0:9473:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f1c4150e00, transno 4294967316 00000100:00100000:0.0:1789185767.470371:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898458368:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1789185767.470496:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1789185767.470545:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898458496:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789185767.470587:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185767.470604:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e05f7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789185767.471347:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898458496 00000100:00100000:3.0:1789185767.471356:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898458496 00000100:00100000:3.0:1789185767.471407:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789185767.471417:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2e97450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9473:x1876096898458496:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789185767.472877:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2e97450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9473:x1876096898458496:12345-0@lo:1000:mdt00_004.0 Request processed in 1457us (2284us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789185767.472891:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789185767.474688:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898458496:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1789185767.474752:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474764:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474772:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474779:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185767.474783:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474791:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474810:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:0.0:1789185767.474814:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185767.474820:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474827:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73aba lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474861:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474867:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474897:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474902:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185767.474904:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474930:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474941:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:0.0:1789185767.474944:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185767.474946:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474953:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a739ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.474991:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.475008:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52078 expref: 22 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.475018:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.475057:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52078 expref: 22 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.475072:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52078 expref: 22 pid: 9473 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185767.475094:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898458624:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185767.475184:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f04240 going to sleep for 11 seconds 00000100:00100000:0.0:1789185767.481767:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.481997:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898458624:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185767.482042:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185767.482692:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879519616 00000100:00100000:2.0:1789185767.482705:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879519616 00010000:00010000:2.0:1789185767.482758:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52078 expref: 23 pid: 9473 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185767.482807:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 91 00000100:00100000:2.0:1789185767.482817:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+23:2392:x1876096879519616:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185767.482851:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185767.482860:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52078 expref: 23 pid: 9473 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.482873:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52078 expref: 23 pid: 9473 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.482899:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73a0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52078 expref: 23 pid: 9473 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.482993:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185767.483000:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.483012:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.483021:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185767.483086:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185767.483088:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483098:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483112:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483119:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483126:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483132:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185767.483137:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483144:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185767.483163:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+22:2392:x1876096879519616:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 335us (1400us total) trans 0 rc 0/0 00010000:00010000:3.0:1789185767.483165:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185767.483171:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185767.483179:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 91 00010000:00010000:3.0:1789185767.483180:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483188:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ac1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483201:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483207:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483212:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483216:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185767.483219:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483224:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483231:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185767.483234:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185767.483236:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.483241:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ab3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185767.483423:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+21:12366:x1876096879519232:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 35865us (36045us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789185767.483432:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 200 00000020:00080000:3.0:1789185767.483436:0:9473:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789185767.483709:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185767.483714:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185767.485812:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789185767.485926:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185767.491064:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185767.491141:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879519872 00000100:00100000:3.0:1789185767.491153:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879519872 00000100:00100000:3.0:1789185767.491215:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 50 00000100:00100000:3.0:1789185767.491227:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6596850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+21:12366:x1876096879519872:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789185767.491543:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789185767.491582:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789185767.491617:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.491706:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.491721:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.491730:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.491736:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.491743:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185767.491811:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789185767.491943:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6596850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+23:12366:x1876096879519872:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 716us (888us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789185767.491952:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 50 00000020:00080000:3.0:1789185767.491958:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789185767.494584:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185767.494599:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.494610:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185767.494615:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.494624:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.494757:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:0.0:1789185767.494761:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789185767.494766:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.494773:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db400/0xda5c730d5a73ac8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185767.494792:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185767.494794:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185767.494796:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185767.718522:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185768.742402:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185768.806944:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185768.807008:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185768.807053:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185768.807087:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185768.807124:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185768.807160:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185768.807199:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185768.807240:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879520512 00000100:00100000:0.0:1789185768.807254:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879520512 00000100:00100000:0.0:1789185768.807338:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879520384 00000100:00100000:0.0:1789185768.807342:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879520384 00000100:00100000:0.0:1789185768.807378:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 143 00000100:00100000:0.0:1789185768.807393:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879520512:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185768.807505:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879520512:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 114us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.807515:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 143 00000100:00100000:0.0:1789185768.807538:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 144 00000100:00100000:0.0:1789185768.807545:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879520384:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185768.807577:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879520384:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.807584:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 144 00000100:00100000:0.0:1789185768.807610:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879520256 00000100:00100000:0.0:1789185768.807615:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879520256 00000100:00100000:0.0:1789185768.807650:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879520128 00000100:00100000:0.0:1789185768.807655:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879520128 00000100:00100000:0.0:1789185768.807676:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879520768 00000100:00100000:0.0:1789185768.807679:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879520768 00000100:00100000:0.0:1789185768.807694:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879520640 00000100:00100000:0.0:1789185768.807696:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879520640 00000100:00100000:0.0:1789185768.807721:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 358 00000100:00100000:0.0:1789185768.807729:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879520256:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185768.807764:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2392:x1876096879520256:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 37us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.807782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 358 00000100:00100000:0.0:1789185768.807799:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 359 00000100:00100000:0.0:1789185768.807807:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+23:2391:x1876096879520128:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185768.807844:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+23:2391:x1876096879520128:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 38us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.807852:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 359 00000100:00100000:0.0:1789185768.807868:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 360 00000100:00100000:0.0:1789185768.807877:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879520768:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185768.807904:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2392:x1876096879520768:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 30us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.807943:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 360 00000100:00100000:0.0:1789185768.807958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 361 00000100:00100000:0.0:1789185768.807966:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879520640:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185768.807996:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2391:x1876096879520640:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 32us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.808002:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 361 00000100:00080000:0.0:1789185768.808029:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185768.808035:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185768.808039:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185768.808633:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879520000 00000100:00100000:3.0:1789185768.808642:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879520000 00000100:00100000:3.0:1789185768.808741:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 396 00000100:00100000:3.0:1789185768.808752:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879520000:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185768.808812:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2392:x1876096879520000:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 62us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185768.808820:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 396 00000100:00100000:0.0:1789185768.870280:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898459008:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.870379:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185768.870432:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898459520:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.870481:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185768.870515:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898460032:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.870543:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185768.870562:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898460544:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.870583:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185768.870613:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789185768.870619:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898459136:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.870647:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185768.870663:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898459648:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.870682:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185768.870699:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898460160:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.870719:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185768.870758:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898459008 00000100:00100000:0.0:1789185768.870768:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898459008 00000100:00100000:0.0:1789185768.870824:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789185768.870834:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898459008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.870896:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898459008:12345-0@lo:400:kworker.0 Request processed in 63us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.870905:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789185768.870971:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898459520 00000100:00100000:0.0:1789185768.870975:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898459520 00000100:00100000:0.0:1789185768.871004:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789185768.871011:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898459520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.871049:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898459520:12345-0@lo:400:kworker.0 Request processed in 38us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.871055:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789185768.871075:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898460032 00000100:00100000:1.0:1789185768.871222:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898458752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185768.871262:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185768.871286:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898459264:0@lo:400:kworker.0 00000100:00100000:1.0:1789185768.871307:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185768.871328:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898459776:0@lo:400:kworker.0 00000100:00100000:2.0:1789185768.871354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898459136 00000100:00100000:1.0:1789185768.871354:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185768.871362:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898459136 00000100:00100000:1.0:1789185768.871376:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898460288:0@lo:400:kworker.0 00000100:00100000:1.0:1789185768.871402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185768.871404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898459648 00000100:00100000:2.0:1789185768.871409:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898459648 00000100:00100000:1.0:1789185768.871420:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789185768.871428:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898458880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185768.871442:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898460160 00000100:00100000:2.0:1789185768.871447:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898460160 00000100:00100000:1.0:1789185768.871454:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185768.871484:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898459776 00000100:00100000:2.0:1789185768.871488:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898459776 00000100:00100000:1.0:1789185768.871495:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898459392:0@lo:400:kworker.0 00000100:00100000:2.0:1789185768.871505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898460288 00000100:00100000:2.0:1789185768.871509:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898460288 00000100:00100000:1.0:1789185768.871540:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185768.871544:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789185768.871556:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898459136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185768.871562:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898459904:0@lo:400:kworker.0 00000100:00100000:1.0:1789185768.871590:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185768.871622:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898459136:12345-0@lo:400:kworker.0 Request processed in 67us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185768.871627:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898460416:0@lo:400:kworker.0 00000100:00100000:2.0:1789185768.871633:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789185768.871635:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898460544 00000100:00100000:3.0:1789185768.871643:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898460544 00000100:00100000:2.0:1789185768.871654:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898459392 00000100:00100000:1.0:1789185768.871656:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185768.871660:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898459392 00000100:00100000:3.0:1789185768.871682:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898459904 00000100:00100000:3.0:1789185768.871688:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898459904 00000100:00100000:1.0:1789185768.871704:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898458752 00000100:00100000:1.0:1789185768.871710:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898458752 00000100:00100000:1.0:1789185768.871742:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898458880 00000100:00100000:1.0:1789185768.871745:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898458880 00000100:00100000:1.0:1789185768.871758:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789185768.871764:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898458752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185768.871791:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185768.871828:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898458752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185768.871834:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789185768.871847:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789185768.871853:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3635:x1876096898458880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185768.871862:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185768.871884:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3635:x1876096898458880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185768.871889:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789185768.871928:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898459264 00000100:00100000:1.0:1789185768.871932:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898459264 00000100:00100000:1.0:1789185768.871955:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789185768.871962:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898459264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185768.871992:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898459264:12345-0@lo:400:kworker.0 Request processed in 31us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185768.872005:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789185768.872061:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789185768.872072:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898459648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185768.872087:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898460416 00000100:00100000:3.0:1789185768.872094:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898460416 00000100:00100000:2.0:1789185768.872107:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898459648:12345-0@lo:400:kworker.0 Request processed in 38us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185768.872119:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789185768.872127:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1876096898460544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185768.872171:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1876096898460544:12345-0@lo:400:kworker.0 Request processed in 45us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185768.872178:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789185768.872191:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789185768.872197:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898459904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185768.872226:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898459904:12345-0@lo:400:kworker.0 Request processed in 29us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185768.872232:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789185768.872249:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789185768.872255:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898460416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185768.872297:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898460416:12345-0@lo:400:kworker.0 Request processed in 42us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185768.872304:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789185768.872392:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789185768.872400:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789185768.872405:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898460160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185768.872419:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789185768.872429:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898459776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185768.872450:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898460160:12345-0@lo:400:kworker.0 Request processed in 49us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185768.872467:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789185768.872485:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789185768.872492:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898460288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.872556:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898460032 00000100:00100000:0.0:1789185768.872598:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789185768.872605:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898460032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.872688:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898460032:12345-0@lo:400:kworker.0 Request processed in 84us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.872695:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789185768.872709:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898459776:12345-0@lo:400:kworker.0 Request processed in 280us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185768.872718:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789185768.872732:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789185768.872742:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898459392:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789185768.872761:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185768.872768:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185768.872773:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185768.872777:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185768.872781:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898459392:12345-0@lo:400:kworker.0 Request processed in 40us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185768.872789:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789185768.872831:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2ff983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898460672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185768.872869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185768.872960:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898459136:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.872976:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898459648:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.872989:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898460160:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.873004:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898459008:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.873020:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898459520:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.873031:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff9f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898460032:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.873044:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898460544:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.873211:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898458880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185768.873223:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898459392:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.873247:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898459904:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.873257:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898460416:0@lo:400:kworker.0 00000100:00100000:0.0:1789185768.873271:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898458752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185768.873281:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898459264:0@lo:400:kworker.0 00010000:00080000:0.0:1789185768.873295:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e2300 x1876096898459776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185768.873305:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898459776:0@lo:400:kworker.0 00000100:00100000:1.0:1789185768.873449:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898460288:12345-0@lo:400:kworker.0 Request processed in 957us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185768.873467:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789185768.873492:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898460672 00000100:00100000:1.0:1789185768.873497:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898460672 00000100:00100000:1.0:1789185768.873525:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789185768.873532:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f300ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898460672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185768.873560:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789185768.873604:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f300ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898460672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185768.873610:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789185768.873641:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2ff983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898460672:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1789185768.873701:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ece00 x1876096898460288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185768.873711:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898460288:0@lo:400:kworker.0 00000040:00080000:3.0:1789185769.150865:0:14719:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185769.150880:0:14719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185769.152854:0:14719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789185769.152868:0:14719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789185769.301857:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185769.301979:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879521024 00000100:00100000:3.0:1789185769.301994:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879521024 00000100:00100000:3.0:1789185769.302094:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 201 00000100:00100000:3.0:1789185769.302107:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+23:12385:x1876096879521024:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185769.302135:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185769.302164:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73acf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520b0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.302341:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73ad6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.302360:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.302378:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185769.302393:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789185769.302558:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73acf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b0 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.302606:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b0 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.302616:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:3.0:1789185769.302619:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789185769.302623:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dac00, rc 0) 00000100:00100000:3.0:1789185769.304095:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+25:12385:x1876096879521024:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1980us (2244us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789185769.304109:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 201 00000100:00080000:3.0:1789185769.304158:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185769.308943:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.308989:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879521152 00000100:00100000:0.0:1789185769.309003:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879521152 00000100:00100000:0.0:1789185769.309078:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 202 00000100:00100000:0.0:1789185769.309090:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+25:12385:x1876096879521152:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:0.0:1789185769.309194:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309216:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309232:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309260:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309269:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309276:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309375:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309383:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309391:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789185769.309533:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309549:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309558:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309566:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309572:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185769.309578:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309593:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309607:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:0.0:1789185769.309611:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.309617:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309624:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73ae4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309637:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309643:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309649:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309654:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dbc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185769.309657:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309663:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309669:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f1c33e2c00) 00010000:00010000:0.0:1789185769.309672:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.309674:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309691:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73aeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309707:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309713:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309719:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309723:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185769.309727:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309732:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309739:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f1c33e2e00) 00010000:00010000:0.0:1789185769.309741:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.309744:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.309748:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73af2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185769.309936:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+25:12385:x1876096879521152:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 846us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185769.309946:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 202 00000100:00100000:0.0:1789185769.334713:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185769.334888:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879521408 00000100:00100000:1.0:1789185769.334902:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879521408 00000100:00100000:1.0:1789185769.335058:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 203 00000100:00100000:1.0:1789185769.335070:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+25:12388:x1876096879521408:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185769.335103:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185769.335139:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73af9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335242:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335260:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335276:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335294:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335308:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335315:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335516:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335526:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335534:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185769.335547:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789185769.335656:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335676:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335684:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335692:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185769.335697:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335705:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335720:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185769.335723:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185769.335730:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335737:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335753:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335760:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335766:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335772:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185769.335781:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335788:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335797:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f300ff3200) 00010000:00010000:1.0:1789185769.335799:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185769.335802:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335808:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335863:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73af9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b7 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335880:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b7 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.335888:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:1.0:1789185769.335891:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185769.335893:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1600, rc 0) 00000100:00100000:1.0:1789185769.336025:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12388:x1876096879521408:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 957us (1328us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789185769.336035:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 203 00000100:00100000:3.0:1789185769.340720:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185769.341512:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879521536 00000100:00100000:2.0:1789185769.341528:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879521536 00000100:00100000:2.0:1789185769.341616:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 204 00000100:00100000:2.0:1789185769.341632:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12388:x1876096879521536:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:2.0:1789185769.341869:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.341905:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.341942:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.342012:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.342035:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.342044:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.342051:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185769.342057:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.342068:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.342120:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:2.0:1789185769.342124:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185769.342134:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.342142:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185769.342281:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12388:x1876096879521536:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 650us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185769.342290:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 204 00000100:00100000:0.0:1789185769.345379:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185769.345816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879521792 00000100:00100000:3.0:1789185769.345829:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879521792 00000100:00100000:3.0:1789185769.345937:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:3.0:1789185769.345951:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12388:x1876096879521792:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185769.346701:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+28:12388:x1876096879521792:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 748us (1333us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789185769.346711:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:0.0:1789185769.369480:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185769.371367:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879522048 00000100:00100000:1.0:1789185769.371390:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879522048 00000100:00100000:1.0:1789185769.371566:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 205 00000100:00100000:1.0:1789185769.371581:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+28:11912:x1876096879522048:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:1.0:1789185769.371637:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185769.371668:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73b23 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520be expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.371860:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.371878:0:8147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b7 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.371887:0:8147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.371954:0:8147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b7 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.371970:0:8147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b7 expref: 29 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185769.371985:0:8147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8147:1876096898460800:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185769.372542:0:8147:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076000 going to sleep for 11 seconds 00000100:00100000:0.0:1789185769.375600:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185769.375938:0:8147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8147:1876096898460800:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185769.375982:0:8147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185769.376076:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879522176 00000100:00100000:2.0:1789185769.376088:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879522176 00010000:00010000:2.0:1789185769.376143:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b7 expref: 30 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185769.376192:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 92 00000100:00100000:2.0:1789185769.376203:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+30:2392:x1876096879522176:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185769.376222:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185769.376230:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b7 expref: 30 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.376243:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b7 expref: 30 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.376283:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1600/0xda5c730d5a73b0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b7 expref: 30 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.376324:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:2.0:1789185769.376329:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.376340:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.376348:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.376379:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185769.376465:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+29:2392:x1876096879522176:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 263us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185769.376473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 92 00010000:00010000:1.0:1789185769.376617:0:8147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.376625:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185769.376659:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789185769.376833:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73b23 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520be expref: 30 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.376853:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520be expref: 29 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.376861:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:1.0:1789185769.376863:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789185769.376866:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1e00, rc 0) 00000100:00100000:1.0:1789185769.376940:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+29:11912:x1876096879522048:12345-192.168.204.48@tcp:101:bash.0 Request processed in 5331us (7457us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789185769.376949:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 205 00000100:00100000:0.0:1789185769.381687:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185769.381891:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879522304 00000100:00100000:1.0:1789185769.381905:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879522304 00000100:00100000:1.0:1789185769.381999:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 206 00000100:00100000:1.0:1789185769.382010:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+29:11912:x1876096879522304:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:1.0:1789185769.382043:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185769.382070:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.382125:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73b3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.382142:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.382180:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.382316:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520c5 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.382345:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520c5 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.382355:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:1.0:1789185769.382359:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185769.382363:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0000, rc 0) 00000100:00100000:1.0:1789185769.382457:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+30:11912:x1876096879522304:12345-192.168.204.48@tcp:101:bash.0 Request processed in 438us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185769.382465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 206 00000100:00100000:3.0:1789185769.386064:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185769.386186:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879522560 00000100:00100000:2.0:1789185769.386200:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879522560 00000100:00100000:2.0:1789185769.386277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 207 00000100:00100000:2.0:1789185769.386289:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+30:11912:x1876096879522560:12345-192.168.204.48@tcp:36:bash.0 00010000:00010000:2.0:1789185769.386660:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.386685:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.386703:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185769.386759:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1789185769.386786:0:6513:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008fe7d02e reply state 0000000078bd0331 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.386821:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.386829:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:2.0:1789185769.386833:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185769.386838:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789185769.386884:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1789185769.387050:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+34:11912:x1876096879522560:12345-192.168.204.48@tcp:36:bash.0 Request processed in 762us (999us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789185769.387060:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 207 00000020:00080000:2.0:1789185769.387067:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789185769.390351:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185769.390574:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879522688 00000100:00100000:1.0:1789185769.390653:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879522688 00000100:00100000:1.0:1789185769.390789:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 208 00000100:00100000:1.0:1789185769.390801:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+34:11912:x1876096879522688:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:1.0:1789185769.390833:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185769.390859:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520cc expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.391040:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520cc expref: 35 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.391060:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520cc expref: 35 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.391104:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:1.0:1789185769.391108:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185769.391113:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1200, rc 0) 00000100:00100000:1.0:1789185769.391368:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+35:11912:x1876096879522688:12345-192.168.204.48@tcp:101:bash.0 Request processed in 568us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185769.391376:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 208 00000100:00100000:0.0:1789185769.397383:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185769.397740:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879522816 00000100:00100000:3.0:1789185769.397754:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879522816 00000100:00100000:3.0:1789185769.397853:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 66 00000100:00100000:3.0:1789185769.397865:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:11912:x1876096879522816:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185769.397902:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185769.397974:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520d3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185769.398008:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4cee5, atime: 0x6aa4cee3, ctime: 0x6aa4cee5, blocks: 0x8 00010000:00010000:3.0:1789185769.398039:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1789185769.398045:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185769.398055:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520d3 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.398077:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520d3 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.398091:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db400, rc 0) 00000100:00100000:3.0:1789185769.398162:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+8:11912:x1876096879522816:12345-192.168.204.48@tcp:101:bash.0 Request processed in 299us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185769.398169:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 66 00000100:00080000:2.0:1789185769.398944:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185769.404772:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185769.404894:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879522944 00000100:00100000:2.0:1789185769.405059:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879522944 00002000:00010000:2.0:1789185769.405122:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789185769.405129:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f2ff983800 with x1876096879522944 ext(0->18446744073709551615) 00002000:00010000:2.0:1789185769.405147:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f2ff983800. 00000100:00100000:2.0:1789185769.405229:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:2.0:1789185769.405241:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879522944:12345-192.168.204.48@tcp:10:bash.0 00002000:00010000:2.0:1789185769.405638:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789185769.405643:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789185765 -> 1789185769 00002000:00010000:2.0:1789185769.405646:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789185763 -> 1789185763 00002000:00010000:2.0:1789185769.405648:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789185765 -> 1789185769 00002000:00010000:2.0:1789185769.405650:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789185769.405750:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879522944:12345-192.168.204.48@tcp:10:bash.0 Request processed in 510us (992us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789185769.405759:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 5 00002000:00010000:2.0:1789185769.405780:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789185769.405783:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f2ff983800 with x1876096879522944 ext(0->18446744073709551615) 00002000:00010000:2.0:1789185769.405789:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f2ff983800. 00000100:00100000:1.0:1789185769.500758:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.500959:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879523072 00000100:00100000:0.0:1789185769.500974:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879523072 00000100:00100000:0.0:1789185769.501044:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 209 00000100:00100000:0.0:1789185769.501056:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+35:12402:x1876096879523072:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:0.0:1789185769.501529:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.501552:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502015:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502040:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502048:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502055:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502155:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502166:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502193:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789185769.502258:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502273:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502280:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502289:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502296:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185769.502301:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502310:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502503:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:0.0:1789185769.502508:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.502516:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502577:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73b5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502596:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502610:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502617:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502622:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185769.502625:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502632:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502640:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f1c33e2e00) 00010000:00010000:0.0:1789185769.502643:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.502646:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502661:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502682:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502689:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502694:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502700:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185769.502709:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502718:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502729:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:0.0:1789185769.502731:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.502734:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.502740:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73b69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185769.503088:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+35:12402:x1876096879523072:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 1953us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185769.503099:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 209 00000100:00100000:0.0:1789185769.529341:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185769.529507:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879523328 00000100:00100000:2.0:1789185769.529522:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879523328 00000100:00100000:2.0:1789185769.529607:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 210 00000100:00100000:2.0:1789185769.529621:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+35:12405:x1876096879523328:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185769.529649:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185769.529677:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73b70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520da expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.529777:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.529804:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.529819:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.529837:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.529844:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.529851:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530034:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73b85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530068:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73b85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530076:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73b85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185769.530088:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789185769.530191:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530199:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530207:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530213:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185769.530218:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530226:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530241:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185769.530244:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185769.530250:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530268:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73b77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530285:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530299:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530305:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530311:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185769.530314:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530319:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530327:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f2fae07500) 00010000:00010000:2.0:1789185769.530330:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185769.530333:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530338:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f000/0xda5c730d5a73b7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530390:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a73b70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520da expref: 38 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530404:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73b85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520da expref: 37 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.530416:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:2.0:1789185769.530419:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789185769.530428:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402fc00, rc 0) 00000100:00100000:2.0:1789185769.530631:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+37:12405:x1876096879523328:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1012us (1304us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789185769.530639:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 210 00000100:00100000:3.0:1789185769.535111:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185769.535783:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879523456 00000100:00100000:1.0:1789185769.535798:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879523456 00000100:00100000:1.0:1789185769.535879:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 211 00000100:00100000:1.0:1789185769.535894:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ff983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+37:12405:x1876096879523456:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:1.0:1789185769.536023:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.536046:0:8147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520be expref: 37 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.536058:0:8147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.536105:0:8147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520be expref: 37 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.536672:0:8147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520be expref: 37 pid: 8147 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185769.536691:0:8147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8147:1876096898460928:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185769.537785:0:8147:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076000 going to sleep for 11 seconds 00000100:00100000:1.0:1789185769.547386:0:8147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8147:1876096898460928:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185769.547432:0:8147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185769.548355:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.548483:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879523712 00000100:00100000:0.0:1789185769.548495:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879523712 00000100:00100000:0.0:1789185769.548568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:0.0:1789185769.548581:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+38:6161:x1876096879523712:12345-192.168.204.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789185769.549175:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+39:6161:x1876096879523712:12345-192.168.204.48@tcp:35:ldlm_bl.0 Request processed in 595us (824us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789185769.549184:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:2.0:1789185769.562550:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185769.563627:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879523840 00000100:00100000:3.0:1789185769.563645:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879523840 00010000:00010000:3.0:1789185769.563710:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520be expref: 39 pid: 8147 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185769.563766:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 93 00000100:00100000:3.0:1789185769.563795:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+39:2391:x1876096879523840:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185769.563816:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185769.563844:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520be expref: 39 pid: 8147 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.563860:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520be expref: 39 pid: 8147 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.563888:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73b2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520be expref: 39 pid: 8147 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.563974:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:3.0:1789185769.563981:0:10394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.563993:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.564008:0:10394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.564047:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185769.564123:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+38:2391:x1876096879523840:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 337us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185769.564131:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 93 00010000:00010000:1.0:1789185769.565122:0:8147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.565137:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.565193:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.565201:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.565209:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.565215:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185769.565220:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.565228:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.565245:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:1.0:1789185769.565248:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185769.565263:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.565291:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73b93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185769.565391:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ff983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+37:12405:x1876096879523456:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 29496us (30290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185769.565402:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 211 00000100:00100000:2.0:1789185769.574211:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.574701:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879524096 00000100:00100000:0.0:1789185769.574716:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879524096 00000100:00100000:0.0:1789185769.574790:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 53 00000100:00100000:0.0:1789185769.574802:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+37:12405:x1876096879524096:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:0.0:1789185769.575802:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+38:12405:x1876096879524096:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 995us (1624us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789185769.575812:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 53 00000100:00100000:3.0:1789185769.647786:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.648402:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879524352 00000100:00100000:0.0:1789185769.648417:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879524352 00000100:00100000:0.0:1789185769.648555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 212 00000100:00100000:0.0:1789185769.648570:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+38:12416:x1876096879524352:12345-192.168.204.48@tcp:101:cat.0 00010000:00010000:0.0:1789185769.648608:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185769.648636:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.648735:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.648754:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.648770:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.648788:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.648796:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.648802:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.648961:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73baf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.648985:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.648991:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185769.649001:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789185769.649090:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649098:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649106:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649187:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185769.649193:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649202:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649217:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:0.0:1789185769.649221:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.649227:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649314:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ba1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649332:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649345:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649351:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649360:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dbc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185769.649363:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649370:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649378:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f1c33e2e00) 00010000:00010000:0.0:1789185769.649381:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185769.649384:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649390:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73ba8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649465:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73b9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e1 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649483:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73baf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e1 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.649491:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:0.0:1789185769.649494:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185769.649504:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021da800, rc 0) 00000100:00100000:0.0:1789185769.649664:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+40:12416:x1876096879524352:12345-192.168.204.48@tcp:101:cat.0 Request processed in 1099us (1892us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789185769.649673:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 212 00000100:00100000:3.0:1789185769.653124:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.653214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879524608 00000100:00100000:0.0:1789185769.653229:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879524608 00000100:00100000:0.0:1789185769.653800:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 54 00000100:00100000:0.0:1789185769.653813:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+40:12416:x1876096879524608:12345-192.168.204.48@tcp:35:cat.0 00000100:00100000:0.0:1789185769.654863:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+41:12416:x1876096879524608:12345-192.168.204.48@tcp:35:cat.0 Request processed in 1043us (1748us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789185769.654876:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 54 00000100:00100000:2.0:1789185769.679191:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185769.680691:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879524864 00000100:00100000:1.0:1789185769.680711:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879524864 00000100:00100000:1.0:1789185769.680797:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 213 00000100:00100000:1.0:1789185769.680812:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e7a4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+41:12417:x1876096879524864:12345-192.168.204.48@tcp:36:rm.0 00010000:00010000:1.0:1789185769.680894:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789185769.680953:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73b4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520cc expref: 41 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.680982:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73baf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e1 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681000:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fc00/0xda5c730d5a73b85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520da expref: 39 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681013:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73b3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520c5 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681024:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:1.0:1789185769.681031:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185769.681061:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681099:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681112:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681131:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681139:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681145:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681262:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681271:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681278:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789185769.681745:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789185769.681758:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 408843849672ns, next at 409843844643ns, rc = 0 00010000:00010000:1.0:1789185769.681814:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681824:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681846:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681856:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681862:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681869:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681901:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185769.681972:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681980:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681987:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.681993:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185769.681999:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682007:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682018:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:1.0:1789185769.682022:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789185769.682035:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682042:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73bcb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682064:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682073:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682079:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682085:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185769.682088:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682094:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682103:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185769.682106:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185769.682109:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682115:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bbd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185769.682125:0:6512:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000945be30b reply state 00000000ea8d0c30 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682151:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.682157:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f300ff3200) 00010000:00010000:1.0:1789185769.682160:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789185769.682164:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185769.682282:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e7a4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+39:12417:x1876096879524864:12345-192.168.204.48@tcp:36:rm.0 Request processed in 1469us (3102us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789185769.682292:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 213 00010000:00010000:0.0:1789185769.683929:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185769.683945:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.683957:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1c00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185769.683963:0:9518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.683974:0:9518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.683993:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:0.0:1789185769.683996:0:9518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789185769.684001:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.684008:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73bd2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.684046:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185769.684048:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185769.684050:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185769.716163:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185769.716335:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879525120 00000100:00100000:1.0:1789185769.716352:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879525120 00000100:00100000:1.0:1789185769.716677:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 214 00000100:00100000:1.0:1789185769.716690:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+39:12423:x1876096879525120:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:1.0:1789185769.716727:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185769.716759:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bd9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520e8 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.717213:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.717232:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.717245:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.717258:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.717291:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.717298:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185769.719195:0:8147:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789185769.719457:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.719478:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.719491:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720045:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720055:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720062:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720069:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185769.720075:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720084:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720179:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185769.720182:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185769.720188:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720195:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1800/0xda5c730d5a73be0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185769.720211:0:8147:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b8f4e049 reply state 00000000594eb188 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720224:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720231:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f300ff3200) 00010000:00010000:1.0:1789185769.720233:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789185769.720237:0:8147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789185769.720284:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73bd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e8 expref: 42 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720302:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e8 expref: 41 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.720310:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f300ff3c00) 00010000:00010000:1.0:1789185769.720312:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185769.720315:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1200, rc 0) 00000100:00100000:1.0:1789185769.720788:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+42:12423:x1876096879525120:12345-192.168.204.48@tcp:101:bash.0 Request processed in 4099us (4639us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789185769.720799:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 214 00000100:00100000:3.0:1789185769.724432:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.724619:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879525248 00000100:00100000:0.0:1789185769.724632:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879525248 00000100:00100000:0.0:1789185769.724709:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:0.0:1789185769.724723:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2390:x1876096879525248:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185769.724747:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185769.724885:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520ef expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789185769.724974:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789185769.725003:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1789185769.725008:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185769.725019:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520ef expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.725048:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520ef expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.725065:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dac00, rc 0) 00000100:00100000:0.0:1789185769.725144:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2390:x1876096879525248:12345-192.168.204.48@tcp:101:bash.0 Request processed in 424us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185769.725152:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:2.0:1789185769.728834:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185769.728938:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879525376 00000100:00100000:3.0:1789185769.728952:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879525376 00000100:00100000:3.0:1789185769.729080:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00100000:3.0:1789185769.729112:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+8:12423:x1876096879525376:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185769.729151:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185769.729177:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520f6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.729222:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520ef expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.729233:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185769.729238:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185769.729245:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.729288:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520ef expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.729303:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520ef expref: 9 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185769.729320:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876096898461056:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185769.729467:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f0f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789185769.732878:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185769.733247:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879525504 00000100:00100000:2.0:1789185769.733260:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879525504 00010000:00010000:2.0:1789185769.733323:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520ef expref: 10 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185769.733379:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 94 00000100:00100000:2.0:1789185769.733391:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2391:x1876096879525504:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185769.733411:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789185769.733438:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876096898461056:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185769.733496:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.733781:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520ef expref: 10 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.733796:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520ef expref: 10 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.733826:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cb76574/0xda5c730d5a73bfc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520ef expref: 10 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.733849:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185769.733861:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185769.733871:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.733882:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.733897:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dba00, rc 0) 00000100:00100000:3.0:1789185769.733996:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+9:12423:x1876096879525376:12345-192.168.204.48@tcp:101:bash.0 Request processed in 4887us (5252us total) trans 0 rc 0/0 00010000:00010000:2.0:1789185769.733999:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185769.734006:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00100000:2.0:1789185769.734017:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6496:1876096898461184:192.168.204.48@tcp:105: 00000100:00100000:2.0:1789185769.734086:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185769.736269:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6496:1876096898461184:192.168.204.48@tcp:105: 00010000:00010000:2.0:1789185769.736309:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185769.736376:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879525504:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 2986us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185769.736388:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 94 00000100:00100000:1.0:1789185769.739734:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185769.741308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879525760 00000100:00100000:2.0:1789185769.741326:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879525760 00000100:00100000:2.0:1789185769.741471:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00100000:2.0:1789185769.741483:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+42:12423:x1876096879525760:12345-192.168.204.48@tcp:35:bash.0 00000100:00100000:2.0:1789185769.742021:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+43:12423:x1876096879525760:12345-192.168.204.48@tcp:35:bash.0 Request processed in 424us (2187us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789185769.742031:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 55 00010000:00010000:0.0:1789185769.766141:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789185769.902860:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1789185769.902885:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1789185769.931797:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185769.931959:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879525888 00000100:00100000:2.0:1789185769.931973:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879525888 00000100:00100000:2.0:1789185769.932073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 215 00000100:00100000:2.0:1789185769.932086:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+43:12439:x1876096879525888:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185769.932118:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185769.932147:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee520fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.932236:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73c11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.932254:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.932271:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185769.932515:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789185769.932520:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185769.932548:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.932582:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520fd expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.932605:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73c11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520fd expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.932615:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185769.932619:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185769.932623:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ec00, rc 0) 00000100:00100000:2.0:1789185769.932770:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+44:12439:x1876096879525888:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 686us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185769.932789:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 215 00000100:00100000:1.0:1789185769.949029:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185769.949144:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879526144 00000100:00100000:2.0:1789185769.949165:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879526144 00000100:00100000:2.0:1789185769.949267:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 216 00000100:00100000:2.0:1789185769.949282:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+44:12439:x1876096879526144:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185769.949331:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185769.949376:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73c18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52104 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.949558:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73c1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.949576:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.949591:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185769.949608:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789185769.949752:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f800/0xda5c730d5a73c18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52104 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.949773:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73c1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52104 expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.949783:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f300ff3c00) 00010000:00010000:2.0:1789185769.949786:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185769.949790:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ea00, rc 0) 00000100:00100000:2.0:1789185769.949964:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+46:12439:x1876096879526144:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 631us (5003us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789185769.949972:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 216 00000100:00100000:1.0:1789185769.959381:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185769.959484:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879526272 00000100:00100000:3.0:1789185769.959501:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879526272 00000100:00100000:1.0:1789185769.959508:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.959539:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879526528 00000100:00100000:0.0:1789185769.959545:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879526528 00000100:00100000:3.0:1789185769.959613:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00100000:0.0:1789185769.959613:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 217 00000100:00100000:0.0:1789185769.959632:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+47:12439:x1876096879526528:12345-192.168.204.48@tcp:101:lfs.0 00000100:00100000:3.0:1789185769.959633:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+47:2391:x1876096879526272:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185769.959660:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185769.959670:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185769.959696:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73c1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52104 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.959699:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5210b expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.959731:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f300ff3c00) 00010000:00010000:3.0:1789185769.959740:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185769.959820:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+47:2391:x1876096879526272:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 194us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185769.959829:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 16 00010000:00010000:0.0:1789185769.959863:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.959883:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.959897:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185769.959940:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789185769.960095:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5210b expref: 48 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.960112:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5210b expref: 47 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.960120:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f300ff3c00) 00010000:00010000:0.0:1789185769.960123:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789185769.960126:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dac00, rc 0) 00000100:00100000:0.0:1789185769.960154:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+47:12439:x1876096879526528:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 529us (647us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789185769.960181:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 217 00000100:00100000:2.0:1789185769.976175:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185769.976274:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879526656 00000100:00100000:3.0:1789185769.976288:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879526656 00000100:00100000:3.0:1789185769.976381:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:3.0:1789185769.976394:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+6:2392:x1876096879526656:12345-192.168.204.48@tcp:1:lfs.0 00010000:00010000:3.0:1789185769.976467:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.976492:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.976521:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789185769.976526:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185769.976532:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.976580:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.976596:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 6 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185769.976614:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876096898461312:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185769.976746:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185769.978749:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876096898461312:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185769.978786:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185769.981671:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185769.982014:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879526784 00000100:00100000:1.0:1789185769.982027:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879526784 00002000:00100000:1.0:1789185769.982103:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff98f1c4156300 x1876096879526784/t0(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:370/0 lens 504/0 e 0 to 0 dl 1789185780 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185769.982126:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c4156300 with x1876096879526784 ext(0->8) 00010000:00010000:1.0:1789185769.982139:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 7 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.982159:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 7 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185769.982169:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f1c4156300 00000100:00100000:1.0:1789185769.982211:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:1.0:1789185769.982224:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879526784:12345-192.168.204.48@tcp:4:lfs.0 00000100:00100000:1.0:1789185769.983347:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879526784:12345-192.168.204.48@tcp:4:lfs.0 Request processed in 1118us (1684us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789185769.983361:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 3 00002000:00100000:1.0:1789185769.983372:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff98f1c4156300 x1876096879526784/t4294967309(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:370/0 lens 504/448 e 0 to 0 dl 1789185780 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789185769.983382:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c4156300 with x1876096879526784 ext(0->8) 00010000:00010000:1.0:1789185769.983403:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185769.983422:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185769.983430:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f1c4156300 00000100:00100000:1.0:1789185769.985968:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.986128:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879526912 00000100:00100000:0.0:1789185769.986142:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879526912 00010000:00010000:0.0:1789185769.986199:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185769.986257:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 95 00000100:00100000:0.0:1789185769.986271:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879526912:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185769.986294:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789185769.986330:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789185769.986334:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789185769 00002000:00010000:0.0:1789185769.986336:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789185769 00002000:00010000:0.0:1789185769.986339:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789185769 00002000:00010000:0.0:1789185769.986341:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789185769.986348:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.986429:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.986475:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a73c03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520f6 expref: 9 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.986496:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185769.986501:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185769.986508:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.986537:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.986579:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185769.986613:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.986626:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.986651:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185769.986659:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879526912:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 390us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185769.986676:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 95 00010000:00010000:3.0:1789185769.986678:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.986689:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.986697:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185769.986703:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.986719:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.986732:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.986740:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a73c42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185769.986798:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879526656:12345-192.168.204.48@tcp:1:lfs.0 Request processed in 10407us (10640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185769.986807:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:2.0:1789185769.990261:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185769.990432:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879527168 00000100:00100000:0.0:1789185769.990457:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879527168 00000100:00100000:0.0:1789185769.990533:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00100000:0.0:1789185769.990546:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6597850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+47:12439:x1876096879527168:12345-192.168.204.48@tcp:35:lfs.0 00000004:00010000:0.0:1789185769.990634:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5210b expref: 47 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185769.990886:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1789185769.990975:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789185769.991410:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1789185769.991469:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.991487:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e8 expref: 51 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.991497:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.991543:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e8 expref: 51 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185769.991581:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e8 expref: 51 pid: 8147 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185769.991599:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876096898461440:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185769.991722:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c205d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789185769.998349:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876096898461440:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185769.998387:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00010000:00010000:0.0:1789185769.998402:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185769.998747:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879527296 00000100:00100000:3.0:1789185769.998758:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879527296 00010000:00010000:3.0:1789185769.998804:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e8 expref: 52 pid: 8147 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185769.998861:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 96 00000100:00100000:3.0:1789185769.998873:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+52:2391:x1876096879527296:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185769.998892:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185769.998901:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e8 expref: 52 pid: 8147 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.999204:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e8 expref: 52 pid: 8147 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.999235:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73bee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520e8 expref: 52 pid: 8147 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.999252:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f300ff3c00) 00010000:00010000:3.0:1789185769.999258:0:10394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.999270:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185769.999279:0:10394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185769.999388:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185769.999485:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+51:2391:x1876096879527296:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 611us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185769.999495:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 96 00010000:00010000:0.0:1789185770.000418:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.000432:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789185770.000629:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1789185770.000773:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789185770.000894:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876096898461568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789185770.001028:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185770.001451:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c205d180 going to sleep for 10 seconds 00000100:00100000:1.0:1789185770.001517:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898461568 00000100:00100000:1.0:1789185770.001789:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898461568 00000100:00100000:1.0:1789185770.001865:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789185770.001880:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1876096898461568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1789185770.001897:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185770.002030:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1876096898461568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 155us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.002038:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789185770.002158:0:6516:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1789185770.002164:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1789185770.002186:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f1c41e9f80, transno 4294967308 00000100:00100000:0.0:1789185770.002203:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876096898461568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789185770.002345:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1789185770.002403:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876096898461696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789185770.002721:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185770.002753:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c205d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185770.002817:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898461696 00000100:00100000:1.0:1789185770.002824:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898461696 00000100:00100000:1.0:1789185770.002890:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789185770.002899:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1876096898461696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789185770.003069:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1876096898461696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 170us (348us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789185770.003077:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789185770.003170:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876096898461696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789185770.003221:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789185770.003260:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.003288:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.003297:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.003304:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185770.003310:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.003321:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.003340:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f300ff3c00) 00010000:00010000:3.0:1789185770.003344:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789185770.003351:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.003357:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c49 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789185770.003485:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789185770.003573:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789185770.003586:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409165676995ns, next at 410165674644ns, rc = 0 00000001:00080000:3.0:1789185770.003593:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789185770.003617:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f300ff3c00) 00010000:00010000:3.0:1789185770.003620:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789185770.003628:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c34 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5210b expref: 55 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185770.003771:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6597850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+54:12439:x1876096879527168:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 13227us (13526us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789185770.003779:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 56 00000020:00080000:3.0:1789185770.003783:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789185770.006414:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.006479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879527424 00000100:00100000:0.0:1789185770.006493:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879527424 00000100:00100000:0.0:1789185770.006568:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 218 00000100:00100000:0.0:1789185770.006581:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+54:12439:x1876096879527424:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185770.006610:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185770.006639:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73c50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52112 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.006723:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73c50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52112 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.006740:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73c50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52112 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.006761:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:0.0:1789185770.006765:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185770.006769:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dbc00, rc 0) 00000100:00100000:0.0:1789185770.006843:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+55:12439:x1876096879527424:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 264us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.006851:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 218 00000100:00100000:2.0:1789185770.009420:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.010819:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879527680 00000100:00100000:0.0:1789185770.010839:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879527680 00000100:00100000:0.0:1789185770.010938:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 57 00000100:00100000:0.0:1789185770.010963:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+55:12439:x1876096879527680:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:0.0:1789185770.011313:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+56:12439:x1876096879527680:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 363us (1907us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789185770.011341:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 57 00000100:00100000:1.0:1789185770.115613:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.115805:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879527808 00000100:00100000:0.0:1789185770.115819:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879527808 00000100:00100000:0.0:1789185770.115976:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 219 00000100:00100000:0.0:1789185770.115989:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+56:12449:x1876096879527808:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:0.0:1789185770.116115:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116140:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116156:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116170:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116179:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116187:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116304:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116313:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116320:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789185770.116405:0:9473:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116422:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116429:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116449:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116455:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185770.116460:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116467:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116489:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:0.0:1789185770.116492:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185770.116499:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116507:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116526:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116532:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116546:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116551:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185770.116555:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116562:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116571:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f300ff3200) 00010000:00010000:0.0:1789185770.116574:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185770.116577:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116582:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116595:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116601:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116607:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116612:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185770.116615:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116634:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116643:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:0.0:1789185770.116645:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185770.116648:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.116653:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.116746:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+56:12449:x1876096879527808:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 758us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.116755:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 219 00000100:00100000:2.0:1789185770.160303:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.160456:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879528064 00000100:00100000:0.0:1789185770.160471:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879528064 00000100:00100000:0.0:1789185770.160583:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 220 00000100:00100000:0.0:1789185770.160597:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+56:12452:x1876096879528064:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185770.160638:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185770.160968:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52119 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.161075:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.161096:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.161111:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.161142:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.161152:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.161159:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161395:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73c81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161405:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161414:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185770.161427:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789185770.161557:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161566:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161587:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161602:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185770.161608:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161626:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161805:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185770.161810:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185770.161818:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161825:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73c73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161845:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161851:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161856:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161861:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185770.161864:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161871:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161890:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f300ff3200) 00010000:00010000:2.0:1789185770.161893:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185770.161897:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.161903:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73c7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.162007:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52119 expref: 59 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.162024:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73c81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52119 expref: 58 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.162032:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185770.162034:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185770.162036:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ee00, rc 0) 00000100:00100000:2.0:1789185770.162122:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+58:12452:x1876096879528064:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1528us (1833us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789185770.162132:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 220 00000100:00100000:2.0:1789185770.167110:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.167207:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879528192 00000100:00100000:1.0:1789185770.167221:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879528192 00000100:00100000:1.0:1789185770.167300:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 221 00000100:00100000:1.0:1789185770.167332:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+58:12452:x1876096879528192:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:1.0:1789185770.167427:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.167464:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.167479:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.167542:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.167551:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.167558:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.167565:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185770.167571:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.167580:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.167595:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:1.0:1789185770.167599:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185770.167604:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.167611:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73c8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.167891:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+58:12452:x1876096879528192:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 561us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.167900:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 221 00000100:00100000:1.0:1789185770.171605:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185770.171758:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879528448 00000100:00100000:3.0:1789185770.171771:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879528448 00000100:00100000:3.0:1789185770.171848:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 58 00000100:00100000:3.0:1789185770.171861:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+58:12452:x1876096879528448:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185770.172368:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+59:12452:x1876096879528448:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 507us (775us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789185770.172377:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 58 00000100:00100000:2.0:1789185770.273129:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.273245:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879528704 00000100:00100000:0.0:1789185770.273261:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879528704 00000100:00100000:0.0:1789185770.273352:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 222 00000100:00100000:0.0:1789185770.273366:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+59:12462:x1876096879528704:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185770.273404:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185770.273408:0:9473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789185770.273458:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73c11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520fd expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.273485:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:0.0:1789185770.273491:0:9473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185770.273510:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c96 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52120 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.273675:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.273690:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.273722:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185770.273734:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789185770.273868:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73c96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52120 expref: 61 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.273885:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52120 expref: 60 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.273894:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:0.0:1789185770.273897:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185770.273901:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dac00, rc 0) 00000100:00100000:0.0:1789185770.274119:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+60:12462:x1876096879528704:12345-192.168.204.48@tcp:101:bash.0 Request processed in 756us (1005us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789185770.274128:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 222 00000100:00100000:2.0:1789185770.280897:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.281385:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879528832 00000100:00100000:1.0:1789185770.281398:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879528832 00000100:00100000:1.0:1789185770.281596:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 223 00000100:00100000:1.0:1789185770.281620:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+60:12462:x1876096879528832:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:1.0:1789185770.281775:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185770.281805:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73cab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52127 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.281851:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.281868:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.281882:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.282299:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73cab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52127 expref: 62 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.282321:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52127 expref: 61 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.282330:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:1.0:1789185770.282341:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185770.282346:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1a00, rc 0) 00000100:00100000:1.0:1789185770.282630:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+61:12462:x1876096879528832:12345-192.168.204.48@tcp:101:bash.0 Request processed in 1021us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.282638:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 223 00000100:00100000:1.0:1789185770.293047:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.297524:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879528960 00000100:00100000:0.0:1789185770.297547:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879528960 00000100:00100000:0.0:1789185770.297765:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:0.0:1789185770.297779:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+61:2390:x1876096879528960:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185770.297799:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185770.297833:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73c9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52120 expref: 61 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.297859:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:0.0:1789185770.297865:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185770.298267:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+60:2390:x1876096879528960:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 490us (5234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.298277:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:1.0:1789185770.315217:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185770.315310:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879529216 00000100:00100000:3.0:1789185770.315323:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879529216 00000100:00100000:3.0:1789185770.315398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 224 00000100:00100000:3.0:1789185770.315410:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+60:12462:x1876096879529216:12345-192.168.204.48@tcp:36:bash.0 00010000:00010000:3.0:1789185770.315494:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185770.315544:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73c81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52119 expref: 60 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.315570:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:3.0:1789185770.315577:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185770.315848:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.315867:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.315901:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185770.316414:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789185770.316461:0:6513:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b3acba70 reply state 000000008cddee77 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.316478:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.316498:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185770.316501:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185770.316506:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185770.316649:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+62:12462:x1876096879529216:12345-192.168.204.48@tcp:36:bash.0 Request processed in 1232us (1439us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789185770.316659:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 224 00000020:00080000:2.0:1789185770.316666:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789185770.326895:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.327142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879529344 00000100:00100000:2.0:1789185770.327157:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879529344 00000100:00100000:2.0:1789185770.327243:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 225 00000100:00100000:2.0:1789185770.327257:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+62:12462:x1876096879529344:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185770.327291:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185770.327320:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73cc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5212e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.327460:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.327481:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.327497:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185770.327538:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789185770.327542:0:6514:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185770.327567:0:6514:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.327601:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73cc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5212e expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.327830:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5212e expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.327841:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185770.327845:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185770.327850:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ec00, rc 0) 00000100:00100000:2.0:1789185770.328067:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+63:12462:x1876096879529344:12345-192.168.204.48@tcp:101:bash.0 Request processed in 812us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.328074:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 225 00000100:00100000:3.0:1789185770.332723:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.334034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879529600 00000100:00100000:0.0:1789185770.334055:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879529600 00000100:00100000:0.0:1789185770.334206:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:0.0:1789185770.334219:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+63:12462:x1876096879529600:12345-192.168.204.48@tcp:35:bash.0 00000100:00100000:0.0:1789185770.334549:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+64:12462:x1876096879529600:12345-192.168.204.48@tcp:35:bash.0 Request processed in 332us (1911us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789185770.334557:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:3.0:1789185770.408448:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.408564:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879529728 00000100:00100000:1.0:1789185770.408579:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879529728 00000100:00100000:1.0:1789185770.408684:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 226 00000100:00100000:1.0:1789185770.408697:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+64:12468:x1876096879529728:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185770.408731:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185770.408758:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73cce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52135 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.408847:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73cd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.408864:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.408879:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185770.408984:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789185770.408989:0:8147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185770.409014:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.409048:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1e00/0xda5c730d5a73cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52135 expref: 66 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.409109:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52135 expref: 65 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.409120:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185770.409124:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185770.409129:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1400, rc 0) 00000100:00100000:1.0:1789185770.409210:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+65:12468:x1876096879529728:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 516us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.409219:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 226 00000100:00100000:3.0:1789185770.414139:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898461824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185770.414241:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185770.414401:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898461824 00000100:00100000:1.0:1789185770.414412:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898461824 00000100:00100000:1.0:1789185770.414486:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789185770.414497:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898461824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185770.414552:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789185770.415257:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.415390:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879529856 00000100:00100000:0.0:1789185770.415397:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879529856 00000100:00100000:0.0:1789185770.415465:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 227 00000100:00100000:0.0:1789185770.415475:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+65:12468:x1876096879529856:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185770.415493:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185770.415526:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73cdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5213c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415618:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415644:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415658:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415671:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415696:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415702:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415794:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73cf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415803:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415810:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185770.415861:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789185770.415866:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185770.415887:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415901:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415945:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415952:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415959:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415974:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185770.415980:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.415988:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416003:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:0.0:1789185770.416007:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185770.416013:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416020:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73ce3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416036:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416042:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416048:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416053:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185770.416056:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416063:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416080:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f300ff3200) 00010000:00010000:0.0:1789185770.416083:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185770.416087:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416093:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416464:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73cdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5213c expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416480:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5213c expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.416487:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:0.0:1789185770.416490:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185770.416492:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db800, rc 0) 00000100:00100000:0.0:1789185770.416734:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12468:x1876096879529856:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1259us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.416743:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 227 00000100:00100000:1.0:1789185770.418164:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898461824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3660us (3914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.418181:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789185770.420527:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898461824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185770.422792:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.422961:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879529984 00000100:00100000:2.0:1789185770.422975:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879529984 00000100:00100000:2.0:1789185770.423059:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:2.0:1789185770.423073:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+66:2392:x1876096879529984:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185770.423108:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185770.423143:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db800/0xda5c730d5a73cf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5213c expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.423170:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185770.423177:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185770.423251:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+65:2392:x1876096879529984:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 183us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.423259:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:2.0:1789185770.430281:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.430376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879530240 00000100:00100000:0.0:1789185770.430390:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879530240 00000100:00100000:0.0:1789185770.430469:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 228 00000100:00100000:0.0:1789185770.430481:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+65:12468:x1876096879530240:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185770.430507:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185770.430543:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73cf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52143 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.432140:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.432172:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5212e expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.432184:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.432240:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5212e expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.432261:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5212e expref: 66 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.432278:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876096898461952:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185770.432772:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c205dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185770.436165:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876096898461952:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185770.436213:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.438518:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185770.438975:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879530368 00000100:00100000:3.0:1789185770.438990:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879530368 00010000:00010000:3.0:1789185770.439058:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5212e expref: 67 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185770.439102:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 97 00000100:00100000:3.0:1789185770.439114:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+67:2392:x1876096879530368:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185770.439135:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185770.439144:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5212e expref: 67 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.439159:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5212e expref: 67 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.439188:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73cc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5212e expref: 67 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.439230:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:3.0:1789185770.439238:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.439250:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.439260:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.439304:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185770.439396:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+66:2392:x1876096879530368:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 283us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.439404:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 97 00010000:00010000:2.0:1789185770.440361:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.440377:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185770.440403:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789185770.440631:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73cf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52143 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.440655:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52143 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.440664:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185770.440667:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789185770.440671:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021da800, rc 0) 00000100:00100000:2.0:1789185770.440737:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12468:x1876096879530240:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 10256us (10469us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789185770.440746:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 228 00000100:00100000:3.0:1789185770.448398:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.448476:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879530624 00000100:00100000:2.0:1789185770.448490:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879530624 00000100:00100000:2.0:1789185770.448571:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:2.0:1789185770.448584:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12468:x1876096879530624:12345-192.168.204.48@tcp:103:lfs.0 00010000:00010000:2.0:1789185770.448607:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185770.448637:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73c50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52112 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.448662:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185770.448693:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185770.448765:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+65:12468:x1876096879530624:12345-192.168.204.48@tcp:103:lfs.0 Request processed in 184us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.448774:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:1.0:1789185770.451816:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.452475:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879530752 00000100:00100000:2.0:1789185770.452490:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879530752 00000100:00100000:2.0:1789185770.452612:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 229 00000100:00100000:2.0:1789185770.452634:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+65:12468:x1876096879530752:12345-192.168.204.48@tcp:58:lfs.0 00010000:00010000:2.0:1789185770.452885:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.452942:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.452958:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185770.453185:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789185770.453300:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+65:12468:x1876096879530752:12345-192.168.204.48@tcp:58:lfs.0 Request processed in 675us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.453309:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 229 00000100:00100000:3.0:1789185770.467374:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.467614:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879530880 00000100:00100000:2.0:1789185770.467640:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879530880 00000100:00100000:2.0:1789185770.468169:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 230 00000100:00100000:2.0:1789185770.468193:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+65:12468:x1876096879530880:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185770.468241:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185770.468308:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5214a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.468543:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.468557:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5214a expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.468592:0:6512:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.468617:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5214a expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.468636:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185770.468639:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185770.468644:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5214a expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.468653:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e000, rc 0) 00000100:00100000:2.0:1789185770.468753:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12468:x1876096879530880:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 564us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.468761:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 230 00000040:00080000:1.0:1789185770.598610:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789185770.598625:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185770.598667:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789185770.598680:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789185770.598890:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898462080:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789185770.599099:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3000763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185770.604835:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.605757:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898462080:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789185770.609263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879531008 00000100:00100000:2.0:1789185770.609284:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879531008 00000100:00100000:2.0:1789185770.609492:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 231 00000100:00100000:2.0:1789185770.609507:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12469:x1876096879531008:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789185770.609556:0:6514:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789185770.609783:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12469:x1876096879531008:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 279us (4963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.609792:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 231 00000100:00100000:3.0:1789185770.621331:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.622232:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879531136 00000100:00100000:0.0:1789185770.622249:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879531136 00000100:00100000:0.0:1789185770.622356:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 232 00000100:00100000:0.0:1789185770.622369:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12469:x1876096879531136:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789185770.622474:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622519:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622534:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622554:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622561:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622568:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622609:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622625:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622632:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185770.622695:0:9473:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789185770.622700:0:9473:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185770.622716:0:9473:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622728:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622745:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622752:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622759:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185770.622763:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622771:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622786:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:0.0:1789185770.622790:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185770.622797:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622802:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021db600/0xda5c730d5a73d1b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622818:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622825:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622831:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622836:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dbc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185770.622844:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622850:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622857:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff98f1c33e2b00) 00010000:00010000:0.0:1789185770.622860:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185770.622862:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622880:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d22 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622896:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622902:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622937:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622943:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185770.622946:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622952:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622959:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:0.0:1789185770.622961:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185770.622969:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.622975:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.623084:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12469:x1876096879531136:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 Request processed in 716us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.623094:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 232 00000100:00100000:3.0:1789185770.628489:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.628953:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879531392 00000100:00100000:2.0:1789185770.628969:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879531392 00000100:00100000:2.0:1789185770.629278:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 233 00000100:00100000:2.0:1789185770.629292:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+66:12469:x1876096879531392:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185770.629321:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185770.629819:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52151 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630116:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630137:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630153:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185770.630168:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789185770.630339:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630415:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630431:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630439:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185770.630464:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630474:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630488:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185770.630491:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789185770.630497:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630660:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630724:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d30 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52151 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630736:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:2.0:1789185770.630739:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185770.630744:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52151 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.630755:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f200, rc 0) 00000100:00100000:2.0:1789185770.630950:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+67:12469:x1876096879531392:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 1659us (2474us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789185770.630962:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 233 00000100:00100000:2.0:1789185770.645868:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.646199:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879531520 00000100:00100000:0.0:1789185770.646226:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879531520 00000100:00100000:0.0:1789185770.646308:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 234 00000100:00100000:0.0:1789185770.646322:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+67:12469:x1876096879531520:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789185770.646387:0:6514:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789185770.646569:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+67:12469:x1876096879531520:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 248us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.646577:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 234 00000100:00100000:3.0:1789185770.651530:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.651791:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879531776 00000100:00100000:1.0:1789185770.651806:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879531776 00000100:00100000:1.0:1789185770.651894:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 235 00000100:00100000:1.0:1789185770.651951:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+67:12469:x1876096879531776:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185770.651979:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185770.651982:0:8147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789185770.652034:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1400/0xda5c730d5a73cd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52135 expref: 67 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.652060:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185770.652067:0:8147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185770.652084:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73d45 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52158 expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789185770.652655:0:8147:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1789185770.652846:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a73d4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.652864:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a73d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.652878:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a73d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.653006:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73d45 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52158 expref: 69 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.653025:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a73d4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52158 expref: 68 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.653060:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f300ff3e00) 00010000:00010000:1.0:1789185770.653064:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185770.653067:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0400, rc 0) 00000100:00100000:1.0:1789185770.653171:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+68:12469:x1876096879531776:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 1265us (1654us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789185770.653182:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 235 00000100:00100000:3.0:1789185770.660676:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.662139:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879532032 00000100:00100000:2.0:1789185770.662158:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879532032 00000100:00100000:2.0:1789185770.662370:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 236 00000100:00100000:2.0:1789185770.662403:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+68:12469:x1876096879532032:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185770.662496:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185770.662532:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0400/0xda5c730d5a73d4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52158 expref: 68 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662571:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f300ff3e00) 00010000:00010000:2.0:1789185770.662585:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185770.662614:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662632:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662644:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662662:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662669:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662677:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662735:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662743:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662761:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662768:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185770.662773:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662782:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662792:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185770.662795:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185770.662800:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662807:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d5a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662818:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662824:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662831:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662836:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185770.662839:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662855:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662864:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x639294c5 (ffff98f2fae07500) 00010000:00010000:2.0:1789185770.662866:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185770.662870:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.662876:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d61 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x639294c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.663026:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+67:12469:x1876096879532032:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 624us (2367us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185770.663034:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 236 00000100:00100000:3.0:1789185770.665600:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.667573:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879532160 00000100:00100000:2.0:1789185770.667596:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879532160 00000100:00100000:2.0:1789185770.667695:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 237 00000100:00100000:2.0:1789185770.667709:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+67:12469:x1876096879532160:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185770.667740:0:9473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185770.667960:0:9473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73d68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5215f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.668972:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.669077:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.669093:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.669251:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a73d68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5215f expref: 69 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.669275:0:9473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5215f expref: 68 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.669285:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:3.0:1789185770.669288:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185770.669293:0:9473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185770.669390:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+68:12469:x1876096879532160:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 1683us (3804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.669399:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 237 00000100:00100000:3.0:1789185770.672700:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.672780:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879532416 00000100:00100000:0.0:1789185770.672794:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879532416 00000100:00100000:0.0:1789185770.672876:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 238 00000100:00100000:0.0:1789185770.672887:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+68:12469:x1876096879532416:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789185770.673034:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.673056:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.673072:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789185770.673354:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1789185770.673441:0:6513:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086de49b8 reply state 000000000908f07b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.673458:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.673467:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:0.0:1789185770.673470:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789185770.673476:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185770.673635:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+70:12469:x1876096879532416:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 748us (949us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789185770.673644:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 238 00000100:00100000:1.0:1789185770.687558:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.687692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879532544 00000100:00100000:0.0:1789185770.687706:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879532544 00000100:00100000:0.0:1789185770.687781:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 239 00000100:00100000:0.0:1789185770.687802:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+70:12469:x1876096879532544:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185770.687834:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185770.687861:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52166 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.688001:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52166 expref: 71 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.688020:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52166 expref: 71 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.688069:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:0.0:1789185770.688073:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185770.688078:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021dbc00, rc 0) 00000100:00100000:0.0:1789185770.688164:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+71:12469:x1876096879532544:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 365us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.688172:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 239 00000100:00100000:3.0:1789185770.699545:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.699642:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879532672 00000100:00100000:0.0:1789185770.699658:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879532672 00000100:00100000:0.0:1789185770.699751:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 70 00000100:00100000:0.0:1789185770.699764:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f76df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2392:x1876096879532672:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789185770.702633:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f76df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2392:x1876096879532672:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 1554us (1786us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789185770.702665:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 70 00000100:00100000:3.0:1789185770.711788:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.712102:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879532928 00000100:00100000:0.0:1789185770.712118:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879532928 00000100:00100000:0.0:1789185770.712264:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:0.0:1789185770.712278:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+71:12469:x1876096879532928:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789185770.712626:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+72:12469:x1876096879532928:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 351us (851us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789185770.712634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:3.0:1789185770.717074:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.719552:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879533184 00000100:00100000:1.0:1789185770.719573:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879533184 00000100:00100000:1.0:1789185770.721199:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 240 00000100:00100000:1.0:1789185770.721230:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+72:12469:x1876096879533184:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789185770.721411:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+72:12469:x1876096879533184:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 197us (4355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.721420:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 240 00000100:00100000:3.0:1789185770.724064:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.724656:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879533312 00000100:00100000:2.0:1789185770.724672:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879533312 00000100:00100000:2.0:1789185770.724756:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 241 00000100:00100000:2.0:1789185770.724769:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+72:12469:x1876096879533312:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789185770.724808:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185770.724836:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5216d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.729248:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.729283:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.729300:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185770.729382:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185770.729411:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.729587:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e600/0xda5c730d5a73d84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5216d expref: 74 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.729615:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5216d expref: 73 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.729625:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:2.0:1789185770.729629:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789185770.729634:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f200, rc 0) 00000100:00100000:2.0:1789185770.729740:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+73:12469:x1876096879533312:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 4971us (5686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.729750:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 241 00000100:00100000:3.0:1789185770.738236:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.738625:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879533440 00000100:00100000:0.0:1789185770.738639:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879533440 00000100:00100000:0.0:1789185770.738711:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 71 00000100:00100000:0.0:1789185770.738722:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+10:2391:x1876096879533440:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185770.738767:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185770.738804:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52174 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789185770.738839:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4ceea, blocks: 0x0 00010000:00010000:0.0:1789185770.738868:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1789185770.738874:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185770.738885:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52174 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.738927:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52174 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.738944:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f3021db600, rc 0) 00000100:00100000:0.0:1789185770.740060:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+11:2391:x1876096879533440:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 1331us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.740071:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 71 00000100:00100000:3.0:1789185770.742662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.746747:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879533696 00000100:00100000:1.0:1789185770.746774:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879533696 00000100:00100000:1.0:1789185770.746892:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 242 00000100:00100000:1.0:1789185770.746957:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+73:12469:x1876096879533696:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789185770.747128:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+73:12469:x1876096879533696:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 224us (4476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.747136:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 242 00000100:00100000:1.0:1789185770.750666:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185770.750764:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879533824 00000100:00100000:3.0:1789185770.750778:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879533824 00000100:00100000:3.0:1789185770.750870:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 72 00000100:00100000:3.0:1789185770.750884:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+11:12469:x1876096879533824:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185770.750945:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185770.750970:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5217b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.751013:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52174 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.751025:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185770.751031:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185770.751037:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 12 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.751082:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52174 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.751099:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52174 expref: 12 pid: 8427 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185770.751117:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876096898462208:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185770.751714:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f0f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789185770.758832:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876096898462208:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185770.758887:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 12 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.759048:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166c800, rc 0) 00000100:00100000:1.0:1789185770.759127:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+12:12469:x1876096879533824:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 8245us (8476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.759136:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 72 00000100:00100000:3.0:1789185770.759455:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.759727:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879533952 00000100:00100000:2.0:1789185770.759737:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879533952 00010000:00010000:2.0:1789185770.759782:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52174 expref: 12 pid: 8427 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.759830:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 98 00000100:00100000:2.0:1789185770.759841:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+12:2391:x1876096879533952:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185770.759860:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185770.759892:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52174 expref: 12 pid: 8427 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.759929:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52174 expref: 12 pid: 8427 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.759960:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a73d92 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52174 expref: 12 pid: 8427 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.759979:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185770.759984:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185770.759994:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.760007:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.760049:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.760067:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1876096898462336:192.168.204.48@tcp:105: 00000100:00100000:2.0:1789185770.760148:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185770.768278:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1876096898462336:192.168.204.48@tcp:105: 00010000:00010000:2.0:1789185770.768321:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185770.768874:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+11:2391:x1876096879533952:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 9029us (9414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.768889:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 98 00000100:00100000:0.0:1789185770.774374:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.774532:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879534080 00000100:00100000:2.0:1789185770.774548:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879534080 00002000:00100000:2.0:1789185770.774629:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff98f1c35e1180 x1876096879534080/t0(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:371/0 lens 504/0 e 0 to 0 dl 1789185781 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185770.774643:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c35e1180 with x1876096879534080 ext(0->12) 00002000:00010000:2.0:1789185770.774651:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c35e1180 00000100:00100000:2.0:1789185770.774697:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:2.0:1789185770.774710:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+11:2391:x1876096879534080:12345-192.168.204.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789185770.776939:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+13:2391:x1876096879534080:12345-192.168.204.48@tcp:4:lhsmtool_posix.0 Request processed in 2191us (2553us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789185770.776958:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 6 00002000:00100000:2.0:1789185770.776974:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff98f1c35e1180 x1876096879534080/t4294967321(0) o4->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:371/0 lens 504/448 e 0 to 0 dl 1789185781 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185770.776985:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c35e1180 with x1876096879534080 ext(0->12) 00002000:00010000:2.0:1789185770.776993:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c35e1180 00000100:00100000:3.0:1789185770.784233:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.784364:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879534208 00000100:00100000:1.0:1789185770.784379:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879534208 00000100:00100000:1.0:1789185770.784471:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 243 00000100:00100000:1.0:1789185770.784483:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+73:12469:x1876096879534208:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789185770.789380:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1789185770.789461:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789185770.789488:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f1c205d180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789185770.789494:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f301043500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f1c205d240 00000020:00080000:1.0:1789185770.789497:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f301043b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f2d284e400 00000004:00080000:1.0:1789185770.789530:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789185770.789564:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f2e05f7f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789185770.789567:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f2d1824000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f2e05f7840 00000020:00080000:1.0:1789185770.789570:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f2d1824900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f2d8b52000 00000100:00100000:1.0:1789185770.789767:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12469:x1876096879534208:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 Request processed in 5279us (5542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.789779:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 243 00000020:00080000:0.0:1789185770.790205:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789185770.790273:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1789185770.790336:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185770.790569:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898462592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789185770.790632:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185770.790687:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898462592 00000100:00100000:0.0:1789185770.790696:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898462592 00000100:00100000:0.0:1789185770.790749:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789185770.790774:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898462592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789185770.790802:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1789185770.790844:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.790871:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520d3 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.790882:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789185770.790887:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789185770.790892:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.790946:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520d3 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.790970:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520d3 expref: 12 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.790985:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876096898462720:192.168.204.48@tcp:104: 00000100:00100000:0.0:1789185770.791042:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c205dd80 going to sleep for 11 seconds 00000100:00080000:0.0:1789185770.791054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789185770.791861:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.791875:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.791882:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.791889:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185770.791894:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.791903:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.791934:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f300ff3600) 00010000:00010000:3.0:1789185770.791938:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185770.791943:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792591:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a73a9e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792635:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792643:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792649:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792672:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185770.792675:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792682:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792692:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f300ff3900) 00010000:00010000:3.0:1789185770.792695:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185770.792698:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792704:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a73b46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792719:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792724:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792730:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792736:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185770.792739:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792744:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792759:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f300ff3200) 00010000:00010000:3.0:1789185770.792762:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185770.792764:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792770:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1000/0xda5c730d5a73bc4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792781:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792787:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792792:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792797:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185770.792800:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792806:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792811:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f300ff3200) 00010000:00010000:3.0:1789185770.792813:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185770.792816:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792832:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a73be7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792853:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792859:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792865:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792869:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185770.792872:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792878:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792885:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:3.0:1789185770.792887:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185770.792890:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792895:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a73cb9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792963:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792971:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792976:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792987:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dac00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185770.792991:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.792996:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.793005:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:3.0:1789185770.793007:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789185770.793010:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.793016:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dac00/0xda5c730d5a73d76 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185770.794161:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185770.794205:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898462464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789185770.794299:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185770.794593:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898462464 00000100:00100000:2.0:1789185770.794605:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898462464 00000100:00100000:2.0:1789185770.794673:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185770.794683:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898462464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789185770.794719:0:9819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1789185770.794763:0:9819:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4cee9, atime: 0x6aa4cee9, ctime: 0x6aa4cee9, blocks: 0x8 00010000:00010000:2.0:1789185770.794790:0:9819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.794809:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1789185770.794813:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185770.794892:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.794941:0:9819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.795112:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.795138:0:8430:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789185770.795150:0:8430:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1789185770.795281:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789185770.795291:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879534336 00000100:00100000:3.0:1789185770.795295:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879534336 00010000:00010000:2.0:1789185770.795352:0:9819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.795506:0:9819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.795534:0:9819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789185770.795752:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3635:x1876096898462464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1069us (1452us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789185770.795760:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185770.795788:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 75 00000100:00100000:2.0:1789185770.795797:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+13:2392:x1876096879534336:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789185770.796166:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876096898462720:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185770.796287:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185770.796297:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.796307:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185770.796313:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.796343:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.796499:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.796509:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024493664/0xda5c730d5a73da7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.796536:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185770.796538:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185770.796539:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789185770.796576:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f1c4154000/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789185770.796584:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898462464:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789185770.796739:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.798574:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185770.799062:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879534464 00000100:00100000:3.0:1789185770.799080:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879534464 00010000:00010000:2.0:1789185770.800064:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520d3 expref: 14 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.800311:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 99 00000100:00100000:2.0:1789185770.800326:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+14:2392:x1876096879534464:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185770.800346:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185770.800353:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520d3 expref: 14 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.801584:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520d3 expref: 14 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.801617:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000588c98d5/0xda5c730d5a73b54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520d3 expref: 14 pid: 8429 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.801638:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185770.801643:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185770.801649:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.801660:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.801709:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185770.801799:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+13:2392:x1876096879534464:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 1476us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.801811:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 99 00010000:00010000:1.0:1789185770.802640:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.802667:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.802680:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.802688:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.802718:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185770.803273:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185770.803283:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.803294:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185770.803300:0:9518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.803310:0:9518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.803343:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.803351:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a73da0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.803388:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185770.803390:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185770.803393:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185770.803798:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1876096898462592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13022us (13161us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789185770.803808:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:2.0:1789185770.804229:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f1c35e0000/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789185770.804243:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898462592:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789185770.806029:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1789185770.806056:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1789185770.806225:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879534336:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 Request processed in 10422us (11109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.806237:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 75 00000100:00100000:0.0:1789185770.810278:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.810652:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879534720 00000100:00100000:1.0:1789185770.810668:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879534720 00000100:00100000:1.0:1789185770.810803:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 244 00000100:00100000:1.0:1789185770.810816:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+21:12469:x1876096879534720:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789185770.810902:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185770.810986:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f200/0xda5c730d5a73d8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5216d expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.811013:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:1.0:1789185770.811020:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185770.811063:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.811104:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.811117:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789185770.811302:0:6512:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c3c6851b reply state 00000000550acac1 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.811317:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.811323:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:1.0:1789185770.811326:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789185770.811329:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789185770.811542:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+22:12469:x1876096879534720:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 727us (1277us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789185770.811550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 244 00000100:00100000:0.0:1789185770.829285:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185770.829474:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879534848 00000100:00100000:3.0:1789185770.829489:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879534848 00000100:00100000:3.0:1789185770.829565:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 76 00000100:00100000:3.0:1789185770.829578:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2392:x1876096879534848:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789185770.829778:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789185770.829783:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789185770 00002000:00010000:3.0:1789185770.829786:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789185769 00002000:00010000:3.0:1789185770.829788:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789185770 -> 1789185770 00002000:00010000:3.0:1789185770.829790:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789185770.829879:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879534848:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 303us (611us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789185770.829888:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 76 00000100:00100000:0.0:1789185770.839961:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.840078:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879535104 00000100:00100000:2.0:1789185770.840092:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879535104 00000100:00100000:2.0:1789185770.840170:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 245 00000100:00100000:2.0:1789185770.840181:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:12469:x1876096879535104:12345-192.168.204.48@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789185770.840270:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.840290:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5215f expref: 22 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.840301:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.840342:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5215f expref: 22 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.840357:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5215f expref: 22 pid: 9473 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.840375:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898462848:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185770.840500:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789185770.847796:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898462848:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185770.847860:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.851646:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.851970:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879535232 00000100:00100000:2.0:1789185770.851984:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879535232 00010000:00010000:2.0:1789185770.852038:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5215f expref: 23 pid: 9473 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.852091:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 100 00000100:00100000:2.0:1789185770.852102:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+23:2392:x1876096879535232:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185770.852123:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185770.852131:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5215f expref: 23 pid: 9473 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.852147:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5215f expref: 23 pid: 9473 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.852178:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da400/0xda5c730d5a73d6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5215f expref: 23 pid: 9473 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.852199:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:2.0:1789185770.852205:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.852216:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.852226:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.852274:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185770.852351:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:2392:x1876096879535232:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 250us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.852952:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 100 00010000:00010000:0.0:1789185770.853171:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.853182:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.853237:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.853244:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.853252:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.853260:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402ea00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185770.853265:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.853273:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.853286:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:0.0:1789185770.853299:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789185770.853305:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.853312:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ea00/0xda5c730d5a73db5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.855459:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:12469:x1876096879535104:12345-192.168.204.48@tcp:55:lhsmtool_posix.0 Request processed in 15261us (15543us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789185770.855479:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 245 00000100:00100000:0.0:1789185770.860236:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.860343:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879535360 00000100:00100000:1.0:1789185770.860369:0:14734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879535360 00000100:00100000:1.0:1789185770.860566:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 77 00000100:00100000:1.0:1789185770.860580:0:14734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879535360:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789185770.860652:0:14734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.860678:0:14734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.860710:0:14734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789185770.860715:0:14734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185770.860721:0:14734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.860768:0:14734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.860785:0:14734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 8 pid: 8429 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.860805:0:14734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14734:1876096898462976:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185770.861304:0:14734:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076240 going to sleep for 11 seconds 00000100:00100000:1.0:1789185770.864441:0:14734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14734:1876096898462976:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185770.864491:0:14734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.864944:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.865272:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879535488 00000100:00100000:1.0:1789185770.865283:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879535488 00010000:00010000:1.0:1789185770.865338:0:10394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 9 pid: 8429 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.865653:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 101 00000100:00100000:1.0:1789185770.865665:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+9:2391:x1876096879535488:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185770.865707:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185770.865741:0:10394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 9 pid: 8429 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.865756:0:10394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 9 pid: 8429 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.865786:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a73d99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5217b expref: 9 pid: 8429 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.865809:0:10394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185770.865814:0:10394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789185770.865820:0:10394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.865831:0:10394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.865874:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185770.866181:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879535488:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 516us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.866190:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 101 00010000:00010000:0.0:1789185770.866270:0:14734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.866282:0:14734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.866309:0:14734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.866318:0:14734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.866326:0:14734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.866334:0:14734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185770.866368:0:14734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.866380:0:14734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.866395:0:14734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.866403:0:14734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000add02426/0xda5c730d5a73dbc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185770.866478:0:14734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879535360:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 Request processed in 5901us (6258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.866487:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 77 00000100:00100000:2.0:1789185770.873193:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.873362:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879535744 00000100:00100000:1.0:1789185770.873375:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879535744 00000100:00100000:1.0:1789185770.873467:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 246 00000100:00100000:1.0:1789185770.873480:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+21:12469:x1876096879535744:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789185770.873611:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.873633:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52127 expref: 21 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.873645:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.873692:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52127 expref: 21 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.873709:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52127 expref: 21 pid: 8147 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.873725:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898463104:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185770.873837:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076240 going to sleep for 11 seconds 00000100:00100000:1.0:1789185770.876749:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898463104:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185770.876792:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.886738:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185770.886841:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879535872 00000100:00100000:3.0:1789185770.886856:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879535872 00010000:00010000:3.0:1789185770.886950:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52127 expref: 22 pid: 8147 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185770.887019:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 102 00000100:00100000:3.0:1789185770.887031:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+22:2392:x1876096879535872:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185770.887052:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185770.887063:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52127 expref: 22 pid: 8147 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.887077:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52127 expref: 22 pid: 8147 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.887117:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1a00/0xda5c730d5a73cb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52127 expref: 22 pid: 8147 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.887135:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:3.0:1789185770.887142:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5214a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.887153:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.887161:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.887170:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185770.887271:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185770.887366:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+21:2392:x1876096879535872:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 329us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185770.887376:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 102 00010000:00010000:1.0:1789185770.887698:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.887710:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.888734:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.888781:0:9473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52166 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.888792:0:9473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.888840:0:9473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52166 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.888857:0:9473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52166 expref: 21 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.888874:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898463232:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185770.889662:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6f04480 going to sleep for 11 seconds 00000100:00100000:2.0:1789185770.895546:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185770.895644:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879536000 00000100:00100000:3.0:1789185770.895656:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879536000 00010000:00010000:3.0:1789185770.895722:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52166 expref: 22 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185770.895777:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 103 00000100:00100000:3.0:1789185770.895788:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+22:2392:x1876096879536000:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185770.895808:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185770.895816:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52166 expref: 22 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.895831:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52166 expref: 22 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.895857:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:3.0:1789185770.895863:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.895875:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.895884:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.895942:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185770.896003:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+22:2392:x1876096879536000:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 217us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.896010:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 103 00010000:00010000:1.0:1789185770.896277:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dbc00/0xda5c730d5a73d7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52166 expref: 21 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.896298:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898463232:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185770.896329:0:9473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.896339:0:9473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.896345:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789185770.896515:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789185770.896669:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1789185770.896707:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789185770.896799:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898463360:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789185770.896865:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185770.897023:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076240 going to sleep for 11 seconds 00000100:00100000:3.0:1789185770.901885:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898463360 00000100:00100000:3.0:1789185770.901977:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898463360 00000100:00100000:3.0:1789185770.902125:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789185770.902161:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9473:x1876096898463360:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789185770.902355:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9473:x1876096898463360:12345-0@lo:1000:mdt00_004.0 Request processed in 197us (5488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185770.902364:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789185770.902462:0:9473:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:1.0:1789185770.902470:0:9473:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:1.0:1789185770.902505:0:9473:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98f1c35e0000 x1876096898462592/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789185786 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185770.902520:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898463360:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789185770.902723:0:9473:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789185770.902818:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898463488:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789185770.902868:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185770.917298:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f0f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185770.919531:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898463488 00000100:00100000:0.0:1789185770.919555:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898463488 00000100:00100000:0.0:1789185770.919652:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789185770.919665:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9473:x1876096898463488:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789185770.920571:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9473:x1876096898463488:12345-0@lo:1000:mdt00_004.0 Request processed in 904us (17697us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789185770.920583:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789185770.920711:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9473:1876096898463488:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789185770.920780:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920793:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920802:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920808:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185770.920814:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920823:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920863:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:1.0:1789185770.920867:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185770.920873:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920881:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920936:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920944:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920950:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920956:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185770.920960:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920967:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.920977:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:1.0:1789185770.920980:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185770.920993:0:9473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5214a expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.921007:0:9473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5214a expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.921027:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5214a expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185770.921245:0:9473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5214a expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.921266:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898463616:192.168.204.48@tcp:105: 00000100:00100000:2.0:1789185770.921379:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789185770.935572:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9473:1876096898463616:192.168.204.48@tcp:105: 00010000:00010000:1.0:1789185770.935620:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935634:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f600/0xda5c730d5a73d0d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935682:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935697:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935709:0:9473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935723:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935729:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935736:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935742:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185770.935746:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935773:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935786:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:1.0:1789185770.935789:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185770.935793:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935799:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73dd1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935809:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935815:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935820:0:9473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935824:0:9473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1c00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185770.935827:0:9473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935832:0:9473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935838:0:9473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:1.0:1789185770.935840:0:9473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185770.935842:0:9473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.935859:0:9473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73dc3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185770.938285:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12469:x1876096879535744:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 64790us (65089us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789185770.938304:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 246 00000020:00080000:2.0:1789185770.938313:0:9473:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789185770.938569:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789185770.938576:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185770.939141:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789185770.939154:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789185770.941728:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185770.941865:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879536128 00000100:00100000:2.0:1789185770.941879:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879536128 00000100:00100000:2.0:1789185770.941984:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:2.0:1789185770.941996:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12468:x1876096879536128:12345-192.168.204.48@tcp:49:lfs.0 00000100:00100000:2.0:1789185770.942308:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12468:x1876096879536128:12345-192.168.204.48@tcp:49:lfs.0 Request processed in 313us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185770.942317:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:0.0:1789185770.955643:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185770.955701:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.955794:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879536640 00000100:00100000:1.0:1789185770.955807:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879536640 00000100:00100000:1.0:1789185770.955885:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 247 00000100:00100000:1.0:1789185770.955898:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12468:x1876096879536640:12345-192.168.204.48@tcp:58:lfs.0 00000040:00080000:1.0:1789185770.956197:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789185770.956285:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12468:x1876096879536640:12345-192.168.204.48@tcp:58:lfs.0 Request processed in 390us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185770.956295:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 247 00000100:00100000:3.0:1789185770.956672:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879536384 00000100:00100000:3.0:1789185770.956680:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879536384 00000100:00100000:3.0:1789185770.956779:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 62 00000100:00100000:3.0:1789185770.956788:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6594050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+24:12469:x1876096879536384:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789185770.957064:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789185770.957118:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1789185770.957161:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.957182:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.957195:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.957206:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.957212:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.957218:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185770.957239:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789185770.957325:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6594050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+26:12469:x1876096879536384:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 537us (1696us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789185770.957349:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 62 00000020:00080000:3.0:1789185770.957353:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789185770.957772:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185770.957782:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.957790:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185770.957794:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.957803:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.957819:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:1.0:1789185770.957822:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789185770.957836:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.957842:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73dd8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.957860:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185770.957863:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185770.957864:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185770.997222:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185770.997468:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879536768 00000100:00100000:1.0:1789185770.997482:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879536768 00000100:00100000:1.0:1789185770.997560:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 248 00000100:00100000:1.0:1789185770.997580:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+26:12471:x1876096879536768:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:1.0:1789185770.997615:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185770.997646:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73ddf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52182 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.997736:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.997754:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.997767:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.997782:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.997789:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.997816:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.998032:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.998044:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52143 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.998054:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.998101:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52143 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185770.998117:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52143 expref: 27 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185770.998135:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898463744:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185770.998306:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789185771.005708:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185771.006144:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879537024 00000100:00100000:0.0:1789185771.006158:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879537024 00000100:00100000:0.0:1789185771.006261:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 63 00000100:00100000:0.0:1789185771.006275:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+28:6161:x1876096879537024:12345-192.168.204.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789185771.006591:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+29:6161:x1876096879537024:12345-192.168.204.48@tcp:35:ldlm_bl.0 Request processed in 319us (897us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789185771.006599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 63 00000100:00080000:2.0:1789185771.006675:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185771.007005:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876096898463744:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185771.007040:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185771.009605:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185771.009722:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879537152 00000100:00100000:0.0:1789185771.009734:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879537152 00010000:00010000:0.0:1789185771.009785:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52143 expref: 29 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185771.009856:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 104 00000100:00100000:0.0:1789185771.009869:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+29:2392:x1876096879537152:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185771.009888:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185771.009896:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52143 expref: 29 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.009963:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52143 expref: 29 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.009993:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021da800/0xda5c730d5a73cff lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52143 expref: 29 pid: 6514 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.010035:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:0.0:1789185771.010040:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.010051:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.010061:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185771.010100:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789185771.010134:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010142:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185771.010182:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+28:2392:x1876096879537152:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 316us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185771.010189:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 104 00000004:00200000:1.0:1789185771.010217:0:6513:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789185771.010222:0:6513:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185771.010248:0:6513:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010263:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010274:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010281:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010288:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010294:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c1200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185771.010299:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010306:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010315:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:1.0:1789185771.010318:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185771.010323:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010328:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1200/0xda5c730d5a73de6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010348:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010354:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010360:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010364:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0c00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185771.010367:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010373:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010380:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f300ff3300) 00010000:00010000:1.0:1789185771.010383:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789185771.010386:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010392:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0c00/0xda5c730d5a73ded lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010444:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c1c00/0xda5c730d5a73ddf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52182 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010460:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52182 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185771.010477:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:1.0:1789185771.010480:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789185771.010482:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0200, rc 0) 00000100:00100000:1.0:1789185771.010528:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12471:x1876096879536768:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 12959us (13323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185771.010535:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 248 00000004:00080000:3.0:1789185771.431949:0:8472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410594036364ns, next at 411594032195ns, rc = 0 00000100:00100000:3.0:1789185771.431996:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898464000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185771.431996:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898463872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185771.432155:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185771.432704:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898463872 00000100:00100000:0.0:1789185771.432717:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898463872 00000100:00100000:0.0:1789185771.433286:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789185771.433301:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898463872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185771.433331:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789185771.433421:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898463872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185771.433428:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1789185771.435548:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185771.435708:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898463872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185771.436530:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185771.436707:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898464000 00000100:00100000:2.0:1789185771.436720:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898464000 00000100:00100000:2.0:1789185771.436786:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789185771.436799:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898464000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185771.437407:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1789185771.437570:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898464000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 772us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185771.437590:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789185771.437726:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898464000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789185771.814490:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185771.942225:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789185771.942238:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185771.942270:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789185771.942285:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789185771.942502:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898464128:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789185771.942849:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48000 going to sleep for 11 seconds 00000100:00100000:1.0:1789185771.958054:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1876096898464128:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789185771.965625:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185771.966204:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879537280 00000100:00100000:1.0:1789185771.966220:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879537280 00000100:00100000:1.0:1789185771.966312:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 249 00000100:00100000:1.0:1789185771.966327:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12482:x1876096879537280:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789185771.966378:0:9473:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789185771.966559:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12482:x1876096879537280:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 235us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185771.966577:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 249 00000100:00100000:0.0:1789185771.994313:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185771.994412:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879537536 00000100:00100000:3.0:1789185771.994426:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879537536 00000100:00100000:3.0:1789185771.994868:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 250 00000100:00100000:3.0:1789185771.994883:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+27:12482:x1876096879537536:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185771.994937:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185771.994966:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73dfb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52189 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.995128:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a73e02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.995147:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a73e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.995164:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a73e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185771.995179:0:6514:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789185771.995337:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73dfb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52189 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.995376:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a73e02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52189 expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185771.995384:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:3.0:1789185771.995387:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185771.995392:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166da00, rc 0) 00000100:00100000:3.0:1789185771.995487:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+29:12482:x1876096879537536:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 606us (1189us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789185771.995495:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 250 00000100:00100000:0.0:1789185772.002245:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185772.002334:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879537664 00000100:00100000:3.0:1789185772.002348:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879537664 00000100:00100000:3.0:1789185772.002443:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:3.0:1789185772.002456:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+29:2389:x1876096879537664:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185772.002478:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185772.002512:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a73e02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52189 expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.002535:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:3.0:1789185772.002543:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185772.002624:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+28:2389:x1876096879537664:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 169us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185772.002632:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:1.0:1789185772.019623:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185772.019724:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879537920 00000100:00100000:3.0:1789185772.019738:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879537920 00000100:00100000:3.0:1789185772.019817:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 251 00000100:00100000:3.0:1789185772.019847:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+28:12482:x1876096879537920:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789185772.019998:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.020020:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.020034:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.020249:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.020258:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.020265:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.020271:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185772.020276:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.020284:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.020298:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:3.0:1789185772.020301:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789185772.020309:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185772.020315:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166c000/0xda5c730d5a73e10 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185772.020491:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+29:12482:x1876096879537920:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 647us (878us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789185772.020500:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 251 00000040:00080000:3.0:1789185772.020637:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185772.020643:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185772.020662:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789185772.020668:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789185772.024323:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185772.025548:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879538176 00000100:00100000:3.0:1789185772.025566:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879538176 00000100:00100000:3.0:1789185772.026542:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 64 00000100:00100000:3.0:1789185772.026566:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+29:12482:x1876096879538176:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789185772.026953:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+30:12482:x1876096879538176:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 397us (2645us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789185772.026962:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 64 00000040:00080000:1.0:1789185772.232788:0:14772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789185772.232806:0:14772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185772.232847:0:14772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789185772.232854:0:14772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789185772.327078:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789185772.334276:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185772.334418:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879538432 00000100:00100000:2.0:1789185772.334432:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879538432 00000100:00100000:2.0:1789185772.334513:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 252 00000100:00100000:2.0:1789185772.334526:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+30:12495:x1876096879538432:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185772.334559:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185772.334588:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73e17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185772.335499:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73e1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185772.335521:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73e1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185772.335536:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73e1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185772.335577:0:6512:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789185772.336234:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ec00/0xda5c730d5a73e17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52190 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185772.336256:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73e1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52190 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185772.336266:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185772.336269:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789185772.336275:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ee00, rc 0) 00000100:00100000:2.0:1789185772.336372:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+32:12495:x1876096879538432:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 1848us (2111us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789185772.336953:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 252 00000100:00100000:2.0:1789185772.339137:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185772.339211:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879538560 00000100:00100000:0.0:1789185772.339223:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879538560 00000100:00100000:0.0:1789185772.339328:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 253 00000100:00100000:0.0:1789185772.339343:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+32:12495:x1876096879538560:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:0.0:1789185772.339447:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185772.339470:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185772.339485:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185772.339571:0:8147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185772.339579:0:8147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185772.339587:0:8147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185772.339594:0:8147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185772.339599:0:8147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185772.339608:0:8147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185772.339622:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:0.0:1789185772.339625:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185772.339648:0:8147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185772.339654:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030800/0xda5c730d5a73e2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185772.340312:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+32:12495:x1876096879538560:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 969us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185772.340323:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 253 00000100:00100000:3.0:1789185772.409101:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185772.409244:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879538688 00000100:00100000:2.0:1789185772.409260:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879538688 00000100:00080000:0.0:1789185772.409338:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185772.409369:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 78 00000100:00100000:2.0:1789185772.409383:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2391:x1876096879538688:12345-192.168.204.48@tcp:101:cat.0 00010000:00010000:2.0:1789185772.409418:0:9819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185772.409453:0:9819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a30ecac5/0xda5c730d5a73e33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52197 expref: -99 pid: 9819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185772.409487:0:9819:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa4ceea, atime: 0x6aa4cee9, ctime: 0x6aa4ceea, blocks: 0x8 00010000:00010000:2.0:1789185772.409513:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1789185772.409518:0:9819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185772.409530:0:9819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a30ecac5/0xda5c730d5a73e33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52197 expref: 8 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185772.409572:0:9819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a30ecac5/0xda5c730d5a73e33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52197 expref: 8 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185772.409587:0:9819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ec00, rc 0) 00000100:00100000:2.0:1789185772.409669:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2391:x1876096879538688:12345-192.168.204.48@tcp:101:cat.0 Request processed in 290us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185772.409676:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 78 00000100:00100000:1.0:1789185772.420221:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185772.420509:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879538816 00000100:00100000:2.0:1789185772.420525:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879538816 00002000:00100000:2.0:1789185772.420597:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff98f1c411dc00 x1876096879538816/t0(0) o3->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:373/0 lens 488/0 e 0 to 0 dl 1789185783 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185772.420611:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c411dc00 with x1876096879538816 ext(0->4095) 00002000:00010000:2.0:1789185772.420619:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c411dc00 00000100:00100000:2.0:1789185772.420760:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:2.0:1789185772.420773:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879538816:12345-192.168.204.48@tcp:3:cat.0 00000100:00100000:2.0:1789185772.421054:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2392:x1876096879538816:12345-192.168.204.48@tcp:3:cat.0 Request processed in 284us (847us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789185772.421078:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 7 00002000:00100000:2.0:1789185772.421086:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff98f1c411dc00 x1876096879538816/t0(0) o3->f993ea83-7802-4340-a17e-bffdbb8158b1@192.168.204.48@tcp:373/0 lens 488/4536 e 0 to 0 dl 1789185783 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789185772.421096:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c411dc00 with x1876096879538816 ext(0->4095) 00002000:00010000:2.0:1789185772.421099:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c411dc00 00010000:00010000:3.0:1789185772.840004:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185773.865147:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185773.945175:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185773.945282:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185773.945319:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185773.945343:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185773.945375:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185773.945397:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185773.945429:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185773.945460:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879539456 00000100:00100000:2.0:1789185773.945473:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879539456 00000100:00100000:2.0:1789185773.945541:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879539328 00000100:00100000:2.0:1789185773.945544:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879539328 00000100:00100000:2.0:1789185773.945582:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 149 00000100:00100000:0.0:1789185773.946488:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879539200 00000100:00100000:0.0:1789185773.946498:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879539200 00000100:00100000:0.0:1789185773.946557:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879539712 00000100:00100000:0.0:1789185773.946561:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879539712 00000100:00100000:0.0:1789185773.946578:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879539072 00000100:00100000:0.0:1789185773.946581:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879539072 00000100:00100000:0.0:1789185773.946607:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879539584 00000100:00100000:0.0:1789185773.946610:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879539584 00000100:00100000:2.0:1789185773.946730:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2389:x1876096879539456:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185773.946741:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 368 00000100:00100000:1.0:1789185773.946755:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879539200:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185773.946841:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2389:x1876096879539456:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 1249us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185773.946851:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 149 00000100:00100000:2.0:1789185773.946875:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 150 00000100:00100000:2.0:1789185773.946883:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2389:x1876096879539328:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185773.948386:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879539200:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 1611us (3080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185773.948460:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879538944 00000100:00100000:3.0:1789185773.948473:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879538944 00000100:00100000:3.0:1789185773.948537:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 398 00000100:00100000:3.0:1789185773.948557:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879538944:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185773.948784:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879538944:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 238us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185773.948792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 398 00000100:00100000:0.0:1789185773.949884:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 369 00000100:00100000:0.0:1789185773.949926:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879539712:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185773.949989:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879539712:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 93us (4644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185773.949995:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 369 00000100:00100000:0.0:1789185773.950024:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 370 00000100:00100000:0.0:1789185773.950031:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+32:2389:x1876096879539072:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185773.950056:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+32:2389:x1876096879539072:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 26us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185773.950062:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 370 00000100:00100000:0.0:1789185773.950072:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 371 00000100:00100000:0.0:1789185773.950095:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879539584:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185773.950119:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879539584:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (4691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185773.950125:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 371 00000100:00100000:1.0:1789185773.951853:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 368 00000100:00100000:2.0:1789185773.952073:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+8:2389:x1876096879539328:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 5186us (6670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185773.952084:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 150 00000100:00080000:2.0:1789185773.952116:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185773.952121:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185773.952125:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185773.991568:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898464384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185773.991980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185773.992083:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898464384 00000100:00100000:3.0:1789185773.992093:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898464384 00000100:00100000:3.0:1789185773.992169:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789185773.992180:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898464384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789185773.992250:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185773.992310:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898464384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185773.992318:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789185773.992342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185773.992858:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898464384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185773.992961:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185773.992973:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898464512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185773.993022:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185773.993834:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898464640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185773.993876:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185773.993929:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898465152:0@lo:400:kworker.0 00000100:00100000:2.0:1789185773.993974:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185773.993996:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898465664:0@lo:400:kworker.0 00000100:00100000:2.0:1789185773.994017:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185773.994038:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789185773.994043:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898464256:0@lo:400:kworker.0 00000100:00100000:2.0:1789185773.994106:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185773.994127:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898464768:0@lo:400:kworker.0 00000100:00100000:2.0:1789185773.994146:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185773.994159:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898465280:0@lo:400:kworker.0 00000100:00100000:2.0:1789185773.994176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185773.994188:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898465792:0@lo:400:kworker.0 00000100:00100000:2.0:1789185773.994206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185773.994340:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898465152 00000100:00100000:3.0:1789185773.994347:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898465152 00000100:00100000:3.0:1789185773.994413:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898465664 00000100:00100000:3.0:1789185773.994417:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898465664 00000100:00100000:3.0:1789185773.994429:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898464768 00000100:00100000:3.0:1789185773.994432:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898464768 00000100:00100000:3.0:1789185773.994441:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898465280 00000100:00100000:3.0:1789185773.994444:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898465280 00000100:00100000:3.0:1789185773.994456:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898465792 00000100:00100000:3.0:1789185773.994458:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898465792 00000100:00100000:3.0:1789185773.994474:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789185773.994483:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898465152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185773.994537:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898465152:12345-0@lo:400:kworker.0 Request processed in 54us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185773.994545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789185773.994573:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789185773.994579:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898465664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185773.994888:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898465664:12345-0@lo:400:kworker.0 Request processed in 309us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185773.994894:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789185773.994932:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789185773.994939:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898464768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185773.994965:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898464768:12345-0@lo:400:kworker.0 Request processed in 27us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185773.994970:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789185773.994980:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789185773.994985:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898465280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185773.995007:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898465280:12345-0@lo:400:kworker.0 Request processed in 23us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185773.995012:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789185773.995022:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789185773.995027:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898465792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185773.995050:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898465792:12345-0@lo:400:kworker.0 Request processed in 24us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185773.995056:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789185773.995102:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898464768:0@lo:400:kworker.0 00010000:00080000:3.0:1789185773.995116:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c4150a80 x1876096898465280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185773.995127:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898465280:0@lo:400:kworker.0 00010000:00080000:3.0:1789185773.995135:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c4151f80 x1876096898465792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185773.995156:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898465792:0@lo:400:kworker.0 00000100:00100000:3.0:1789185773.995169:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898465152:0@lo:400:kworker.0 00000100:00100000:3.0:1789185773.995178:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898465664:0@lo:400:kworker.0 00000100:00100000:3.0:1789185773.995217:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898465024:0@lo:400:kworker.0 00000100:00100000:1.0:1789185773.995845:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898464512 00000100:00100000:1.0:1789185773.995854:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898464512 00000100:00100000:1.0:1789185773.995900:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789185773.995918:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898464512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185773.995952:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789185773.995996:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898464512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185773.996002:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789185773.999096:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898464640 00000100:00100000:2.0:1789185773.999116:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898464640 00000100:00100000:2.0:1789185773.999203:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789185773.999214:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876096898464640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185773.999259:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789185773.999358:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876096898464640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185773.999378:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789185773.999414:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898464256 00000100:00100000:2.0:1789185773.999419:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898464256 00000100:00100000:2.0:1789185773.999441:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789185773.999447:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898464256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185773.999478:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898464256:12345-0@lo:400:kworker.0 Request processed in 32us (5372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185773.999491:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789185773.999561:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898464256:0@lo:400:kworker.0 00000100:00100000:2.0:1789185773.999586:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898464640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185774.000003:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185774.000209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898465024 00000100:00100000:3.0:1789185774.000215:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898465024 00000100:00100000:3.0:1789185774.000256:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789185774.000264:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898465024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185774.000305:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898465024:12345-0@lo:400:kworker.0 Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185774.000311:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:3.0:1789185774.000333:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789185774.000338:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185774.000342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185774.000484:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898464896:0@lo:400:kworker.0 00000100:00100000:3.0:1789185774.000527:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185774.000562:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898465408:0@lo:400:kworker.0 00000100:00100000:3.0:1789185774.000589:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185774.004113:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898464896 00000100:00100000:0.0:1789185774.004137:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898464896 00000100:00100000:0.0:1789185774.004251:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789185774.004263:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898464896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185774.004821:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898464896:12345-0@lo:400:kworker.0 Request processed in 559us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185774.004830:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789185774.005107:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898465408 00000100:00100000:3.0:1789185774.005114:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898465920:0@lo:400:kworker.0 00000100:00100000:1.0:1789185774.005114:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898465408 00000100:00100000:3.0:1789185774.005166:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185774.005168:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789185774.005176:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898465408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185774.005217:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898464512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185774.005220:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898465408:12345-0@lo:400:kworker.0 Request processed in 46us (4630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185774.005226:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789185774.005256:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898465920 00000100:00100000:1.0:1789185774.005259:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898465920 00000100:00100000:1.0:1789185774.005282:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789185774.005288:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1876096898465920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185774.005317:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1876096898465920:12345-0@lo:400:kworker.0 Request processed in 29us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185774.005323:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1789185774.005822:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185774.006356:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898464896:0@lo:400:kworker.0 00000100:00100000:3.0:1789185774.006680:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898465408:0@lo:400:kworker.0 00000100:00100000:3.0:1789185774.008924:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898465920:0@lo:400:kworker.0 00000100:00100000:3.0:1789185774.009034:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898465024:0@lo:400:kworker.0 00000100:00100000:3.0:1789185774.009048:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898465536:0@lo:400:kworker.0 00000100:00100000:3.0:1789185774.009133:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185774.009566:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898465536 00000100:00100000:0.0:1789185774.009577:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898465536 00000100:00100000:0.0:1789185774.009672:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789185774.009838:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898465536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185774.009944:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898465536:12345-0@lo:400:kworker.0 Request processed in 263us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185774.009954:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1789185774.010835:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185774.010882:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898465536:0@lo:400:kworker.0 00010000:00010000:2.0:1789185774.886242:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185775.526159:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185775.526194:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898466048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185775.526298:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185775.527077:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898466048 00000100:00100000:2.0:1789185775.527091:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898466048 00000100:00100000:2.0:1789185775.527164:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789185775.527177:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898466048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185775.527228:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789185775.527314:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898466048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185775.527323:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789185775.527399:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898466048:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789185775.910075:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789185776.042007:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789185776.042043:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000004:00080000:3.0:1789185776.551712:0:8472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 415713802702ns, next at 416713798661ns, rc = 0 00000100:00100000:2.0:1789185776.551713:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898466304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185776.551755:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898466176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185776.556842:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185776.557039:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898466304 00000100:00100000:2.0:1789185776.557051:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898466304 00000100:00100000:2.0:1789185776.557118:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789185776.557131:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898466304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185776.557174:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789185776.557254:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898466304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185776.557262:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1789185776.557291:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185776.557353:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898466304:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1789185776.560141:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:1.0:1789185776.560177:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789185776.560213:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f2c302e3c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789185776.560218:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f2d2802100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f2c302e000 00000020:00080000:1.0:1789185776.560222:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98f2d2802e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f1c32a9c00 00000020:00080000:1.0:1789185776.560244:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789185776.560370:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789185776.560475:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1789185776.560487:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185776.560511:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898466432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789185776.560600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185776.560671:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898466432 00000100:00100000:1.0:1789185776.560681:0:14734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898466432 00000100:00100000:1.0:1789185776.560748:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789185776.560759:0:14734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898466432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789185776.561137:0:14734:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789185776.561142:0:14734:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789185770 -> 1789185770 00002000:00010000:1.0:1789185776.561145:0:14734:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1789185769 -> 1789185769 00002000:00010000:1.0:1789185776.561165:0:14734:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789185770 -> 1789185770 00002000:00010000:1.0:1789185776.561168:0:14734:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789185776.561222:0:14734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3638:x1876096898466432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 465us (623us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789185776.561230:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:1.0:1789185776.561294:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f1c19b5500/2, rc 0, transno 4294967325 00000100:00100000:1.0:1789185776.561301:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898466432:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789185776.562243:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185776.562273:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185776.562283:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185776.562290:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185776.562296:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185776.562305:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185776.562340:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f2c4f8df00) 00010000:00010000:2.0:1789185776.562343:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185776.562349:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185776.562356:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0600/0xda5c730d5a73dae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789185776.562398:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185776.563848:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1789185776.566556:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1789185776.566578:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:2.0:1789185776.566715:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898466176 00000100:00100000:2.0:1789185776.566730:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898466176 00000100:00100000:2.0:1789185776.566809:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789185776.566821:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898466176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789185776.566856:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789185776.566989:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898466176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185776.566998:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789185776.567638:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789185776.567648:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f1c35e0000, transno 4294967322 00000004:00080000:3.0:1789185776.567659:0:3635:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789185776.567693:0:3635:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98f1c19b5500 x1876096898466432/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789185792 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185776.567717:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898466176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789185776.935212:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185777.961842:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185778.138247:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185778.142399:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879539840 00000100:00100000:3.0:1789185778.142428:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879539840 00000100:00100000:3.0:1789185778.142577:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 254 00000100:00100000:3.0:1789185778.142590:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12148:x1876096879539840:12345-192.168.204.48@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789185778.142721:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12148:x1876096879539840:12345-192.168.204.48@tcp:60:lhsmtool_posix.0 Request processed in 135us (4483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185778.142728:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 254 00000100:00080000:2.0:1789185778.146384:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185778.146799:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185778.150374:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879539968 00000100:00100000:0.0:1789185778.150391:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879539968 00000100:00100000:0.0:1789185778.150539:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 255 00000100:00100000:0.0:1789185778.150554:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:12148:x1876096879539968:12345-192.168.204.48@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789185778.150683:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:12148:x1876096879539968:12345-192.168.204.48@tcp:60:lhsmtool_posix.0 Request processed in 133us (3888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185778.150707:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 255 00000100:00080000:2.0:1789185778.154166:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185778.156363:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185778.156516:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879540224 00000100:00100000:3.0:1789185778.156527:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879540224 00000100:00100000:3.0:1789185778.156592:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00100000:3.0:1789185778.156602:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+18:12148:x1876096879540224:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789185778.156859:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+19:12148:x1876096879540224:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 257us (504us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789185778.156866:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 65 00010000:00010000:2.0:1789185778.993505:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185779.049860:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185779.049975:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185779.050005:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185779.050041:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185779.050078:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185779.050105:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185779.050131:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185779.050165:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879540352 00000100:00100000:3.0:1789185779.050179:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879540352 00000100:00100000:3.0:1789185779.050243:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 400 00000100:00100000:3.0:1789185779.050255:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879540352:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185779.050360:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879540352:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.050388:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 400 00000100:00100000:3.0:1789185779.050426:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879540480 00000100:00100000:3.0:1789185779.050430:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879540480 00000100:00100000:3.0:1789185779.050474:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879540992 00000100:00100000:3.0:1789185779.050477:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879540992 00000100:00100000:3.0:1789185779.050500:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879540608 00000100:00100000:3.0:1789185779.050502:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879540608 00000100:00100000:3.0:1789185779.050515:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879541120 00000100:00100000:3.0:1789185779.050517:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879541120 00000100:00100000:3.0:1789185779.050533:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 378 00000100:00100000:3.0:1789185779.050538:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+19:2389:x1876096879540480:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185779.050587:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+19:2389:x1876096879540480:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 47us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.050593:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 378 00000100:00100000:3.0:1789185779.050607:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 379 00000100:00100000:3.0:1789185779.050612:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879540992:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185779.050634:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879540992:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 21us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.050639:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 379 00000100:00100000:3.0:1789185779.050649:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 380 00000100:00100000:3.0:1789185779.050654:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879540608:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185779.050674:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879540608:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 21us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.050679:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 380 00000100:00100000:3.0:1789185779.050690:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 381 00000100:00100000:3.0:1789185779.050703:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879541120:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185779.050727:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2389:x1876096879541120:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.050732:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 381 00000100:00100000:2.0:1789185779.055357:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879540736 00000100:00100000:2.0:1789185779.055688:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879540736 00000100:00100000:2.0:1789185779.055766:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879540864 00000100:00100000:2.0:1789185779.055770:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879540864 00000100:00100000:2.0:1789185779.055800:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 154 00000100:00100000:2.0:1789185779.055809:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2389:x1876096879540736:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185779.055882:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2389:x1876096879540736:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 74us (5907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185779.055889:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 154 00000100:00100000:2.0:1789185779.055946:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 155 00000100:00100000:2.0:1789185779.055953:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879540864:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185779.055977:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2389:x1876096879540864:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (5871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185779.055982:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 155 00000100:00080000:2.0:1789185779.056007:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185779.056011:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185779.056013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185779.056016:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185779.110179:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789185779.110213:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898467072:0@lo:400:kworker.0 00000100:00100000:0.0:1789185779.110318:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185779.110401:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898466688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185779.110425:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185779.110444:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898466560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185779.110479:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185779.110507:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898467584:0@lo:400:kworker.0 00000100:00100000:0.0:1789185779.110533:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185779.110549:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898468096:0@lo:400:kworker.0 00000100:00100000:0.0:1789185779.110569:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185779.110584:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789185779.110589:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898467200:0@lo:400:kworker.0 00000100:00100000:0.0:1789185779.110608:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185779.110621:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898467712:0@lo:400:kworker.0 00000100:00100000:0.0:1789185779.110640:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185779.110654:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898468224:0@lo:400:kworker.0 00000100:00100000:0.0:1789185779.110686:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185779.110721:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898467072 00000100:00100000:0.0:1789185779.110730:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898467072 00000100:00100000:3.0:1789185779.110893:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898466688 00000100:00100000:3.0:1789185779.110898:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898466688 00000100:00100000:3.0:1789185779.110952:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789185779.110964:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898467072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111039:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898467072:12345-0@lo:400:kworker.0 Request processed in 78us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.111047:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789185779.111081:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789185779.111088:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898466688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185779.111117:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789185779.111154:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898466688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.111160:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789185779.111184:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898467584 00000100:00100000:3.0:1789185779.111188:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898467584 00000100:00100000:3.0:1789185779.111226:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898468096 00000100:00100000:3.0:1789185779.111229:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898468096 00000100:00100000:3.0:1789185779.111248:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898467200 00000100:00100000:3.0:1789185779.111250:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898467200 00000100:00100000:3.0:1789185779.111275:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789185779.111281:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898467584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111314:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898467584:12345-0@lo:400:kworker.0 Request processed in 34us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.111344:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789185779.111357:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789185779.111362:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898468096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111388:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898468096:12345-0@lo:400:kworker.0 Request processed in 26us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.111393:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789185779.111402:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789185779.111407:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898467200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111431:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898467200:12345-0@lo:400:kworker.0 Request processed in 24us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.111436:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789185779.111486:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898466560 00000100:00100000:3.0:1789185779.111490:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898466560 00000100:00100000:3.0:1789185779.111521:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789185779.111528:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898466560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789185779.111551:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185779.111581:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898466560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.111586:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789185779.111602:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898467712 00000100:00100000:3.0:1789185779.111605:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898467712 00000100:00100000:3.0:1789185779.111639:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898468224 00000100:00100000:3.0:1789185779.111642:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898468224 00000100:00100000:3.0:1789185779.111658:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789185779.111664:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898467712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111692:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898467712:12345-0@lo:400:kworker.0 Request processed in 29us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.111705:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789185779.111717:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789185779.111722:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898468224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111749:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898468224:12345-0@lo:400:kworker.0 Request processed in 27us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.111753:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789185779.111812:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898467200:0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111823:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898467712:0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111832:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898468224:0@lo:400:kworker.0 00010000:00080000:3.0:1789185779.111844:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f301cb0700 x1876096898467584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185779.111855:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898467584:0@lo:400:kworker.0 00010000:00080000:3.0:1789185779.111864:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f301cb2d80 x1876096898468096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185779.111872:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898468096:0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111881:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898467072:0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.111895:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898466688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185779.111935:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898466560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185779.115195:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898466816:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.115329:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185779.115386:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898467328:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.115422:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185779.115447:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898467840:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.115469:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185779.115487:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898468352:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.115506:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185779.115538:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789185779.115545:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898466944:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.115572:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185779.115592:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898467456:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.115613:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185779.115631:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898467968:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.115650:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185779.115684:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898467840 00000100:00100000:1.0:1789185779.115711:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898467840 00000100:00100000:1.0:1789185779.115766:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898468352 00000100:00100000:1.0:1789185779.115768:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898468352 00000100:00100000:1.0:1789185779.115785:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789185779.115794:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898467840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.115853:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898467840:12345-0@lo:400:kworker.0 Request processed in 60us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185779.115860:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789185779.115881:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789185779.115886:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898468352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.115963:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898468352:12345-0@lo:400:kworker.0 Request processed in 75us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185779.115969:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789185779.116008:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898466944 00000100:00100000:1.0:1789185779.116013:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898466944 00000100:00100000:2.0:1789185779.116019:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898467328 00000100:00100000:2.0:1789185779.116037:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898467328 00000100:00100000:1.0:1789185779.116044:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898467456 00000100:00100000:1.0:1789185779.116049:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898467456 00000100:00100000:1.0:1789185779.116085:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898467968 00000100:00100000:1.0:1789185779.116089:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898467968 00000100:00100000:2.0:1789185779.116123:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789185779.116127:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789185779.116148:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898466944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185779.116152:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898467328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.116188:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898466944:12345-0@lo:400:kworker.0 Request processed in 46us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185779.116196:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789185779.116210:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789185779.116221:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898467456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185779.116318:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898466816 00000100:00100000:3.0:1789185779.116324:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898466816 00000100:00100000:3.0:1789185779.116357:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789185779.116374:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898466816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.116662:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898467456:12345-0@lo:400:kworker.0 Request processed in 445us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185779.116679:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789185779.116692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789185779.116697:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898467968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.116725:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876096898467968:12345-0@lo:400:kworker.0 Request processed in 28us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185779.116730:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789185779.116796:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898466944:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.116806:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898467456:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.116815:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876096898467968:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.116826:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898467328:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.116836:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898467840:0@lo:400:kworker.0 00000100:00100000:1.0:1789185779.116845:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789185779.116852:0:3635:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1789185779.116880:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f1c4154000, transno 4294967311 00000100:00100000:1.0:1789185779.116896:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898468352:0@lo:400:kworker.0 00000100:00080000:1.0:1789185779.117052:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185779.117058:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185779.117062:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789185779.117065:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185779.117074:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185779.117086:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898468480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185779.117124:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185779.117308:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898468480 00000100:00100000:1.0:1789185779.117320:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898468480 00000100:00100000:1.0:1789185779.117349:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789185779.117355:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898468480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185779.117370:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789185779.118709:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898468480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185779.119703:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898468480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185779.119725:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789185779.145085:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898467328:12345-0@lo:400:kworker.0 Request processed in 28931us (29646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185779.145136:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789185779.154225:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3635:x1876096898466816:12345-0@lo:400:kworker.0 Request processed in 37837us (38881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185779.154245:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789185779.155254:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898466816:0@lo:400:kworker.0 00010000:00010000:0.0:1789185780.006086:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185780.646461:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898468608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185780.646577:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185780.646697:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898468608 00000100:00100000:1.0:1789185780.646708:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898468608 00000100:00100000:1.0:1789185780.646792:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789185780.646804:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898468608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185780.646853:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789185780.680706:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898468608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 33887us (34113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185780.680727:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789185780.685962:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898468608:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185781.033606:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789185781.633656:0:14971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:02:59 (1789185779) 00000100:00100000:0.0:1789185781.671232:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185781.671267:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898468736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185781.671368:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185781.671429:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898468736 00000100:00100000:3.0:1789185781.671441:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898468736 00000100:00100000:0.0:1789185781.671450:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898468864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185781.671479:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185781.671509:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898468864 00000100:00100000:3.0:1789185781.671513:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898468864 00000100:00100000:0.0:1789185781.671516:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789185781.671527:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898468736:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185781.671529:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789185781.671534:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898468864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789185781.671563:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00002000:00000024:0.0:1789185781.671563:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789185781.671609:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898468736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185781.671616:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1789185781.671629:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185781.675236:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898468864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3672us (3727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185781.675255:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789185781.677722:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898468736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185781.678173:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898468864:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789185782.059901:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185782.246248:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789185782.246256:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789185782.246358:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1789185782.246364:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1789185782.248057:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789185782.248070:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000004:00080000:2.0:1789185782.248089:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:3.0:1789185782.248191:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789185782.248201:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1789185782.571977:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1789185782.706946:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:2.0:1789185783.078662:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185784.104511:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185784.169558:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185784.169612:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185784.169645:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185784.169667:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185784.169684:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185784.169719:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185784.169765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879541376 00000100:00100000:0.0:1789185784.169792:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879541376 00000100:00100000:0.0:1789185784.169865:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879541888 00000100:00100000:0.0:1789185784.169869:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879541888 00000100:00100000:2.0:1789185784.169879:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879541632 00000100:00100000:2.0:1789185784.169883:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879541632 00000100:00100000:0.0:1789185784.169903:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879541504 00000100:00100000:0.0:1789185784.169929:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879541504 00000100:00100000:2.0:1789185784.169936:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879541760 00000100:00100000:2.0:1789185784.169938:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879541760 00000100:00100000:0.0:1789185784.169952:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 388 00000100:00100000:0.0:1789185784.169964:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:2390:x1876096879541376:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185784.169971:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 160 00000100:00100000:2.0:1789185784.169979:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2390:x1876096879541632:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185784.170063:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:2390:x1876096879541376:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 100us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185784.170072:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 388 00000100:00100000:0.0:1789185784.170092:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 389 00000100:00100000:0.0:1789185784.170099:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879541888:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185784.170100:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2390:x1876096879541632:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 122us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185784.170107:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 160 00000100:00100000:2.0:1789185784.170122:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 161 00000100:00100000:0.0:1789185784.170123:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879541888:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185784.170128:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879541760:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185784.170129:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 389 00000100:00100000:0.0:1789185784.170138:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 390 00000100:00100000:0.0:1789185784.170144:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879541504:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185784.170149:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879541760:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 22us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185784.170155:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 161 00000100:00100000:0.0:1789185784.170164:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2390:x1876096879541504:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 20us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185784.170182:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 390 00000100:00100000:0.0:1789185784.170218:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879541248 00000100:00100000:0.0:1789185784.170223:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879541248 00000100:00100000:0.0:1789185784.170261:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 402 00000100:00100000:0.0:1789185784.170268:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879541248:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185784.170292:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2389:x1876096879541248:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185784.170307:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 402 00000100:00080000:0.0:1789185784.170338:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789185784.170344:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789185784.170345:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185784.170348:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185784.179387:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185784.179487:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879542016 00000100:00100000:0.0:1789185784.179501:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879542016 00000100:00100000:0.0:1789185784.179603:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 391 00000100:00100000:0.0:1789185784.179616:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879542016:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185784.179726:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2390:x1876096879542016:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185784.179735:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 391 00000100:00080000:2.0:1789185784.179932:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185784.236901:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898468992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185784.240178:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898469376:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241340:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241452:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898469504:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241502:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241530:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898470016:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241584:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898470528:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241607:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241655:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898469120:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241688:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241713:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898469632:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241738:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241756:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898470144:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241778:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241799:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898470656:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241822:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241846:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789185784.241853:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898469248:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241897:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898469760:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241939:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241958:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898470272:0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.241979:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.241999:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898470784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185784.242024:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185784.242066:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898468992 00000100:00100000:3.0:1789185784.242086:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898468992 00000100:00100000:3.0:1789185784.242139:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898469632 00000100:00100000:3.0:1789185784.242143:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898469632 00000100:00100000:3.0:1789185784.242164:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789185784.242186:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898468992:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185784.243419:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789185784.243436:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898469632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.243525:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898469632:12345-0@lo:400:kworker.0 Request processed in 96us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185784.243533:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789185784.243574:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185784.243608:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898469888:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.243642:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185784.243678:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f301cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898470400:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.243699:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185784.243715:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898470912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185784.243737:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185784.243769:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898470784 00000100:00100000:1.0:1789185784.243774:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898470784 00000100:00100000:1.0:1789185784.243823:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898470912 00000100:00100000:1.0:1789185784.243826:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898470912 00000100:00100000:1.0:1789185784.243842:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789185784.243848:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898470784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185784.243877:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185784.243933:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898470784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185784.243940:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789185784.243955:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789185784.243961:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898470912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185784.243971:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185784.243998:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898470912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185784.244005:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1789185784.244022:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185784.244035:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898469376 00000100:00100000:1.0:1789185784.244038:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898469376 00000100:00100000:1.0:1789185784.244056:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789185784.244061:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3635:x1876096898469376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.244092:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3635:x1876096898469376:12345-0@lo:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185784.244109:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789185784.244158:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898470912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185784.244184:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898469376:0@lo:400:kworker.0 00000004:00000024:3.0:1789185784.247508:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789185784.247612:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898468992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5423us (6273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.247623:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789185784.247680:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898469504 00000100:00100000:3.0:1789185784.247688:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898469504 00000100:00100000:3.0:1789185784.247721:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898469248 00000100:00100000:3.0:1789185784.247724:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898469248 00000100:00100000:3.0:1789185784.247735:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898469760 00000100:00100000:3.0:1789185784.247738:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898469760 00000100:00100000:3.0:1789185784.247782:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898470272 00000100:00100000:3.0:1789185784.247786:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898470272 00000100:00100000:3.0:1789185784.247798:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898469888 00000100:00100000:3.0:1789185784.247800:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898469888 00000100:00100000:3.0:1789185784.247831:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898470400 00000100:00100000:3.0:1789185784.247835:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898470400 00000100:00100000:3.0:1789185784.247851:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789185784.247860:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898469504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.247901:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898469504:12345-0@lo:400:kworker.0 Request processed in 42us (6398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.247928:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789185784.247941:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789185784.247947:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898469248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.247977:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898469248:12345-0@lo:400:kworker.0 Request processed in 30us (6099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.247999:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789185784.248012:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789185784.248019:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898469760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.248048:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898469760:12345-0@lo:400:kworker.0 Request processed in 30us (6109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.248054:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789185784.248065:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789185784.248071:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898470272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.248097:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898470272:12345-0@lo:400:kworker.0 Request processed in 26us (6116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.248102:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789185784.248113:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789185784.248119:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898469888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.248149:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876096898469888:12345-0@lo:400:kworker.0 Request processed in 30us (4506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.248155:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789185784.248181:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789185784.248188:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898470400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.248215:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898470400:12345-0@lo:400:kworker.0 Request processed in 28us (4514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.248221:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789185784.248246:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898470016 00000100:00100000:3.0:1789185784.248249:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898470016 00000100:00100000:3.0:1789185784.248279:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898470528 00000100:00100000:3.0:1789185784.248283:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898470528 00000100:00100000:3.0:1789185784.248305:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898470144 00000100:00100000:3.0:1789185784.248309:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898470144 00000100:00100000:3.0:1789185784.248321:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898470656 00000100:00100000:3.0:1789185784.248323:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898470656 00000100:00100000:3.0:1789185784.248335:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789185784.248340:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898470016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.248371:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898470016:12345-0@lo:400:kworker.0 Request processed in 31us (6809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.248376:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789185784.248573:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789185784.248582:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898470528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.248619:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898470528:12345-0@lo:400:kworker.0 Request processed in 38us (7010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.248625:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789185784.248638:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789185784.248644:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898470144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.248667:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898470144:12345-0@lo:400:kworker.0 Request processed in 24us (6889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.248673:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789185784.248702:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789185784.248710:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898470656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.248737:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898470656:12345-0@lo:400:kworker.0 Request processed in 30us (6915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.248743:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789185784.248769:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898469120 00000100:00100000:3.0:1789185784.248774:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898469120 00000100:00100000:3.0:1789185784.248864:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789185784.248880:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898469120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185784.248945:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3637:x1876096898469120:12345-0@lo:400:kworker.0 Request processed in 66us (7256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.248951:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00080000:1.0:1789185784.251376:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789185784.251392:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185784.251395:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185784.251466:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898469248:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.251487:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898469760:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.251501:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898470272:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.251530:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898470784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185784.251543:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898469120:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.251557:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898469632:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.251568:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1789185784.251575:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f1c19b5500, transno 4294967325 00000100:00100000:1.0:1789185784.251594:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898470144:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.251607:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898470656:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.251686:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898468992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185784.251701:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898469504:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.251715:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898470016:0@lo:400:kworker.0 00000100:00100000:1.0:1789185784.251724:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898470528:0@lo:400:kworker.0 00010000:00080000:1.0:1789185784.251779:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f301cb3480 x1876096898469888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185784.251791:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876096898469888:0@lo:400:kworker.0 00010000:00080000:1.0:1789185784.251805:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f301cb0e00 x1876096898470400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185784.251813:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f301cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898470400:0@lo:400:kworker.0 00000100:00100000:0.0:1789185784.634100:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185784.634277:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879542144 00000100:00100000:3.0:1789185784.634291:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879542144 00000100:00100000:3.0:1789185784.634376:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 256 00000100:00100000:3.0:1789185784.634389:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:13168:x1876096879542144:12345-192.168.204.48@tcp:101:lsof.0 00010000:00010000:3.0:1789185784.634417:0:8147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185784.634444:0:8147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a73e3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5219e expref: -99 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185784.634532:0:8147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73e41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185784.634549:0:8147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73e41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185784.634562:0:8147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73e41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185784.634629:0:8147:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789185784.634633:0:8147:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789185784.634690:0:8147:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73e41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185784.634721:0:8147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166da00/0xda5c730d5a73e3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5219e expref: 7 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185784.634745:0:8147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73e41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5219e expref: 6 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185784.634774:0:8147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2700) 00010000:00010000:3.0:1789185784.634777:0:8147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789185784.634783:0:8147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166d600, rc 0) 00000100:00100000:3.0:1789185784.634870:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:13168:x1876096879542144:12345-192.168.204.48@tcp:101:lsof.0 Request processed in 483us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185784.634878:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 256 00010000:00010000:3.0:1789185785.126592:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185785.770295:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898471040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185785.770410:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185785.770958:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898471040 00000100:00100000:0.0:1789185785.770972:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898471040 00000100:00100000:0.0:1789185785.771043:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789185785.771054:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898471040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789185785.771107:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789185785.771192:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898471040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185785.771200:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789185785.772742:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898471040:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185786.150400:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185786.262734:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185786.263144:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879542400 00000100:00100000:1.0:1789185786.263160:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879542400 00000100:00100000:1.0:1789185786.263263:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 66 00000100:00100000:1.0:1789185786.263277:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+18:13170:x1876096879542400:12345-192.168.204.48@tcp:35:umount.0 00000100:00100000:1.0:1789185786.263636:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+19:13170:x1876096879542400:12345-192.168.204.48@tcp:35:umount.0 Request processed in 361us (914us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789185786.263644:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 66 00000100:00080000:2.0:1789185786.264039:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185786.269730:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185786.273486:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879542656 00000100:00100000:3.0:1789185786.273510:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879542656 00000100:00100000:3.0:1789185786.273615:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:3.0:1789185786.273629:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+19:13170:x1876096879542656:12345-192.168.204.48@tcp:35:umount.0 00000100:00100000:3.0:1789185786.275025:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+20:13170:x1876096879542656:12345-192.168.204.48@tcp:35:umount.0 Request processed in 1387us (5297us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789185786.275039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:0.0:1789185786.286765:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185786.287040:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879542912 00000100:00100000:1.0:1789185786.287054:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879542912 00000100:00100000:1.0:1789185786.287140:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00100000:1.0:1789185786.287153:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2e6597c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+20:13170:x1876096879542912:12345-192.168.204.48@tcp:35:umount.0 00000100:00100000:1.0:1789185786.287474:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2e6597c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:13170:x1876096879542912:12345-192.168.204.48@tcp:35:umount.0 Request processed in 322us (723us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789185786.287483:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00100000:0.0:1789185786.290626:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185786.291466:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879543168 00000100:00100000:1.0:1789185786.291482:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879543168 00000100:00100000:1.0:1789185786.291570:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:1.0:1789185786.291582:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+21:13170:x1876096879543168:12345-192.168.204.48@tcp:35:umount.0 00000100:00100000:1.0:1789185786.292313:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f993ea83-7802-4340-a17e-bffdbb8158b1+22:13170:x1876096879543168:12345-192.168.204.48@tcp:35:umount.0 Request processed in 729us (1695us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789185786.292323:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:2.0:1789185786.297069:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185786.297389:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879543680 00000100:00100000:3.0:1789185786.297402:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879543680 00000100:00100000:3.0:1789185786.297618:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 80 00000100:00100000:0.0:1789185786.297625:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185786.297637:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2388:x1876096879543680:12345-192.168.204.48@tcp:9:umount.0 00000100:00100000:0.0:1789185786.297659:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000020:00000080:3.0:1789185786.297691:0:9819:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a73144 00000100:00080000:3.0:1789185786.297704:0:9819:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fe800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789185786.297763:0:9819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789185786.297936:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185786.297980:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879543424 00000100:00100000:0.0:1789185786.297984:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879543424 00000100:00100000:3.0:1789185786.298028:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f993ea83-7802-4340-a17e-bffdbb8158b1+2:2388:x1876096879543680:12345-192.168.204.48@tcp:9:umount.0 Request processed in 386us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185786.298029:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879543296 00000100:00100000:0.0:1789185786.298033:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879543296 00000100:00100000:3.0:1789185786.298043:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 80 00000100:00100000:0.0:1789185786.298048:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879543552 00000100:00100000:0.0:1789185786.298052:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879543552 00000100:00100000:0.0:1789185786.298075:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:3.0:1789185786.298082:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:0.0:1789185786.298088:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+15:2391:x1876096879543424:12345-192.168.204.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789185786.298095:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+15:2391:x1876096879543296:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185786.298104:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185786.298112:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185786.298147:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789185786.298159:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789185786.298640:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddf800/0xda5c730d5a72d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cb9 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185786.298663:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185786.298716:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+14:2391:x1876096879543424:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 632us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185786.298724:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:0.0:1789185786.298745:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:0.0:1789185786.298752:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+13:2391:x1876096879543552:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185786.298762:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185786.298772:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300dde800/0xda5c730d5a73041 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dd1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185786.298781:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185786.298798:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+12:2391:x1876096879543552:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 47us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185786.298804:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 23 00010000:00010000:3.0:1789185786.298834:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c13a3000/0xda5c730d5a72da8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cf8 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185786.298849:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185786.299192:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879543296:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 1096us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185786.299214:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:0.0:1789185786.304221:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185786.304280:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879544064 00000100:00100000:3.0:1789185786.304294:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879544064 00000100:00100000:3.0:1789185786.304513:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 81 00000100:00100000:3.0:1789185786.304531:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+7:2388:x1876096879544064:12345-192.168.204.48@tcp:9:umount.0 00000100:00080000:2.0:1789185786.304539:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789185786.304573:0:8427:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a733ba 00000020:00010000:3.0:1789185786.304585:0:8427:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98f1c37b7000: total 0 00000100:00080000:3.0:1789185786.304591:0:8427:0:(import.c:65:import_set_state_nolock()) ffff98f2d8be7000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1789185786.304632:0:9517:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98f1c37b7000: total 0 00010000:00010000:0.0:1789185786.304791:0:9517:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98f1c37b7000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789185786.304862:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a30ecac5/0xda5c730d5a73e33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52197 expref: 6 pid: 9819 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185786.304905:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a73772 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fbb expref: 5 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185786.305321:0:9517:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98f1c37b7000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789185786.305343:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185786.305345:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185786.305347:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789185786.305610:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789185786.305880:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+2:2388:x1876096879544064:12345-192.168.204.48@tcp:9:umount.0 Request processed in 1354us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185786.305889:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 81 00000100:00100000:0.0:1789185786.312306:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185786.312376:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879545088 00000100:00100000:3.0:1789185786.312390:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879545088 00000100:00100000:3.0:1789185786.312475:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 257 00000100:00100000:3.0:1789185786.312487:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+22:2388:x1876096879545088:12345-192.168.204.48@tcp:39:umount.0 00000020:00000080:3.0:1789185786.312532:0:6512:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72d77 00000020:00010000:3.0:1789185786.312557:0:6512:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98f1c316f000: total 0 00000100:00080000:3.0:1789185786.312563:0:6512:0:(import.c:65:import_set_state_nolock()) ffff98f1c3169000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789185786.312704:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1789185786.312932:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f993ea83-7802-4340-a17e-bffdbb8158b1+21:2388:x1876096879545088:12345-192.168.204.48@tcp:39:umount.0 Request processed in 419us (613us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789185786.312942:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 257 00000020:00010000:2.0:1789185786.313195:0:6499:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98f1c316f000: total 0 00010000:00010000:2.0:1789185786.313266:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98f1c316f000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789185786.313308:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185786.313311:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789185786.313321:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a737e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fd7 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313340:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185786.313343:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185786.313347:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a73df4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52182 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313358:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:2.0:1789185786.313361:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185786.313364:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fe00/0xda5c730d5a73733 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fa6 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313378:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f2c4f8d900) 00010000:00010000:2.0:1789185786.313380:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789185786.313384:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dac00/0xda5c730d5a73ad6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee520b0 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313404:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185786.313406:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789185786.313410:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a73415 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ed4 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313439:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f1c33d9200) 00010000:00010000:2.0:1789185786.313442:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185786.313447:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a730bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51de6 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313803:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2700) 00010000:00010000:2.0:1789185786.313807:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185786.313812:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f3021dae00/0xda5c730d5a737cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fd0 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313828:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185786.313831:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789185786.313834:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402ee00/0xda5c730d5a73e1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52190 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313845:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:2.0:1789185786.313847:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789185786.313851:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a7375d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51fb4 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313862:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f2d703d000) 00010000:00010000:2.0:1789185786.313864:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185786.313868:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2000/0xda5c730d5a73653 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51f6e expref: 11 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.313885:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f1c33d9d00) 00010000:00010000:2.0:1789185786.313888:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185786.313900:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a730a3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51ddf expref: 10 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.314065:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f2fae07900) 00010000:00010000:2.0:1789185786.314068:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789185786.314072:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30daa00/0xda5c730d5a7311a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dfb expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.314090:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f1c33e2d00) 00010000:00010000:2.0:1789185786.314092:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789185786.314096:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e000/0xda5c730d5a73d14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5214a expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185786.314109:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98f1c316f000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789185786.314147:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185786.314149:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185786.314151:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185786.320240:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185786.320357:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879545216 00000100:00100000:3.0:1789185786.320370:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879545216 00000100:00100000:3.0:1789185786.320465:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 258 00000100:00100000:3.0:1789185786.320478:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+5:2388:x1876096879545216:12345-192.168.204.48@tcp:39:umount.0 00000020:00000080:3.0:1789185786.320523:0:9473:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72d7e 00000100:00080000:3.0:1789185786.320547:0:9473:0:(import.c:65:import_set_state_nolock()) ffff98f1c310d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789185786.320587:0:9473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1789185786.320647:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185786.320821:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f993ea83-7802-4340-a17e-bffdbb8158b1+3:2388:x1876096879545216:12345-192.168.204.48@tcp:39:umount.0 Request processed in 346us (597us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789185786.320831:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 258 00000100:00080000:2.0:1789185786.321234:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185786.790929:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185786.790969:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898471168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185786.791076:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185786.792497:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898471296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185786.792589:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185786.793242:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898471168 00000100:00100000:1.0:1789185786.793259:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898471168 00000100:00100000:1.0:1789185786.793333:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898471296 00000100:00100000:1.0:1789185786.793337:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898471296 00000100:00080000:2.0:1789185786.793358:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185786.793368:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789185786.793379:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898471168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185786.793412:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789185786.793490:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789185786.793509:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898471168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185786.793511:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c41ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898471296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185786.793532:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00002000:00000024:2.0:1789185786.793549:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789185786.793595:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898471168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185786.793614:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c41ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898471296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185786.793623:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789185786.793633:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898471296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789185787.175658:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185788.198850:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185788.809063:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185788.809289:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185788.817993:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185788.826957:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879545472 00000100:00100000:2.0:1789185788.826973:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879545472 00000100:00100000:2.0:1789185788.827062:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879545344 00000100:00100000:3.0:1789185788.827199:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:3.0:1789185788.827211:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+10:2391:x1876096879545472:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185788.827228:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185788.827247:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0030200/0xda5c730d5a72e81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d3e expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185788.827266:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185788.827340:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:2391:x1876096879545472:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 131us (18288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185788.827349:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:2.0:1789185788.827774:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879545344 00000100:00100000:2.0:1789185788.827831:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:2.0:1789185788.827838:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+9:2392:x1876096879545344:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185788.827848:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185788.827858:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c1bf9200/0xda5c730d5a72e7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51d0d expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185788.827868:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185788.827944:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:2392:x1876096879545344:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 69us (18619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185788.827952:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:0.0:1789185788.828607:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185788.828633:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879545856 00000100:00100000:0.0:1789185788.828640:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879545856 00000100:00100000:0.0:1789185788.828683:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 259 00000100:00100000:0.0:1789185788.828691:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+6:2388:x1876096879545856:12345-192.168.204.48@tcp:39:umount.0 00000020:00000080:0.0:1789185788.828743:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72e8f 00000020:00010000:0.0:1789185788.828752:0:6514:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98f1c3523800: total 0 00000100:00080000:0.0:1789185788.828758:0:6514:0:(import.c:65:import_set_state_nolock()) ffff98f1c3523000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789185788.828781:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1789185788.828987:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2388:x1876096879545856:12345-192.168.204.48@tcp:39:umount.0 Request processed in 295us (382us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1789185788.829012:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 259 00000100:00080000:2.0:1789185788.829522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1789185788.829532:0:6499:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98f1c3523800: total 0 00010000:00010000:2.0:1789185788.829579:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98f1c3523800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789185788.829609:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33e2700) 00010000:00010000:2.0:1789185788.829613:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185788.829621:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c166d600/0xda5c730d5a73e41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5219e expref: 4 pid: 8147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185788.829644:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98f1c3523800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789185788.829654:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185788.829656:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185788.829658:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185788.829671:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879545600 00000100:00100000:2.0:1789185788.829676:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879545600 00000100:00100000:2.0:1789185788.829728:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:2.0:1789185788.829735:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+8:2389:x1876096879545600:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185788.829746:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185788.829762:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c1bf9800/0xda5c730d5a7303a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51dca expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185788.829773:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185788.829802:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+7:2389:x1876096879545600:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 68us (11820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185788.829809:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:0.0:1789185788.847953:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185788.848140:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879545984 00000100:00100000:3.0:1789185788.848175:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879545984 00000100:00100000:3.0:1789185788.848274:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 260 00000100:00100000:3.0:1789185788.848288:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+5:2388:x1876096879545984:12345-192.168.204.48@tcp:39:umount.0 00000020:00000080:3.0:1789185788.848353:0:6512:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72e96 00000100:00080000:3.0:1789185788.848370:0:6512:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789185788.848406:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789185788.848641:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc75c41c-3996-44b9-8c8f-b4e6d0f7796c+3:2388:x1876096879545984:12345-192.168.204.48@tcp:39:umount.0 Request processed in 351us (734us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789185788.848664:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 260 00010000:00010000:3.0:1789185788.848989:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789185788.849203:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185788.905021:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185788.905267:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879546240 00000100:00100000:0.0:1789185788.905282:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879546240 00000100:00100000:0.0:1789185788.905361:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 404 00000100:00100000:0.0:1789185788.905374:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+7:2388:x1876096879546240:12345-192.168.204.48@tcp:251:umount.0 00000020:00000080:0.0:1789185788.905437:0:6507:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72d54 00000020:00010000:0.0:1789185788.905449:0:6507:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98f1c316e000: total 0 00000100:00080000:0.0:1789185788.905457:0:6507:0:(import.c:65:import_set_state_nolock()) ffff98f1c3168800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789185788.905830:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f24e88-33a8-40da-ba13-9f98e96cc9b7+3:2388:x1876096879546240:12345-192.168.204.48@tcp:251:umount.0 Request processed in 457us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185788.905839:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 404 00000020:00010000:2.0:1789185788.907715:0:6500:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98f1c316e000: total 0 00010000:00010000:2.0:1789185788.907726:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185788.907814:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98f1c316e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789185788.907863:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddf400/0xda5c730d5a72daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee51cff expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185788.907884:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98f1c316e000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789185788.907895:0:6500:0:(genops.c:885:class_export_put()) final put ffff98f1c316e000/b7f24e88-33a8-40da-ba13-9f98e96cc9b7 00010000:00010000:2.0:1789185788.908065:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185788.908068:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185788.908088:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789185788.908215:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c316e000/b7f24e88-33a8-40da-ba13-9f98e96cc9b7 for MGS 00000020:00000080:0.0:1789185788.908464:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c3168800 for MGS 00010000:00010000:1.0:1789185789.222450:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185789.350344:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898471552:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.350453:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185789.350464:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898471680:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.350515:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185789.350529:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898472064:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.350544:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898472192:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.350560:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185789.350584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185789.350588:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898472576:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.350619:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898472704:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.350627:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185789.350655:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898473088:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.350658:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185789.350689:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185789.350696:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898473216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185789.350725:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789185789.350733:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185789.350735:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898471424:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.350772:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185789.350789:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789185789.350799:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898472320:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.350806:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898471936:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.350833:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185789.350864:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898471552 00000100:00100000:3.0:1789185789.350873:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898471552 00000100:00100000:3.0:1789185789.350958:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898472192 00000100:00100000:3.0:1789185789.350962:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898472192 00000100:00100000:3.0:1789185789.351093:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898472704 00000100:00100000:3.0:1789185789.351097:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898472704 00000100:00100000:3.0:1789185789.351110:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898472320 00000100:00100000:3.0:1789185789.351113:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898472320 00000100:00100000:3.0:1789185789.351130:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789185789.351138:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898471552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185789.351161:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898471808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185789.352425:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898471552:12345-0@lo:400:kworker.0 Request processed in 1280us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.352439:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789185789.352478:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789185789.352492:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898472192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.352541:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898472192:12345-0@lo:400:kworker.0 Request processed in 56us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.352547:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789185789.352560:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789185789.352566:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898472704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.352595:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898472704:12345-0@lo:400:kworker.0 Request processed in 30us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.352601:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789185789.352612:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789185789.352620:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898472320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.352648:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898472320:12345-0@lo:400:kworker.0 Request processed in 30us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.352653:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789185789.352685:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898471680 00000100:00100000:3.0:1789185789.352691:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898471680 00000100:00100000:3.0:1789185789.352729:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898472064 00000100:00100000:3.0:1789185789.352741:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898472064 00000100:00100000:3.0:1789185789.352759:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789185789.352765:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898471680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.352801:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898471680:12345-0@lo:400:kworker.0 Request processed in 37us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.352807:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789185789.352818:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789185789.352824:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898472064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.352851:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898472064:12345-0@lo:400:kworker.0 Request processed in 28us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.352864:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789185789.352893:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898472576 00000100:00100000:3.0:1789185789.352897:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898472576 00000100:00100000:3.0:1789185789.352950:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898473088 00000100:00100000:3.0:1789185789.352953:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898473088 00000100:00100000:3.0:1789185789.353051:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789185789.353060:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898472576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.353108:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898472576:12345-0@lo:400:kworker.0 Request processed in 49us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.353113:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789185789.353125:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789185789.353131:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898473088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.353161:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898473088:12345-0@lo:400:kworker.0 Request processed in 30us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.353166:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789185789.353260:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898471424 00000100:00100000:3.0:1789185789.353267:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898471424 00010000:00080000:2.0:1789185789.353286:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c41ec380 x1876096898472320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185789.353305:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898472320:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.353307:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1789185789.353319:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898471424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.353326:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898472832:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.353372:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185789.353396:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898473344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185789.353418:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898471424:12345-0@lo:400:kworker.0 Request processed in 100us (2645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.353426:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789185789.353431:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185789.353462:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898471680:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.353463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898472832 00000100:00100000:3.0:1789185789.353469:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898472832 00000100:00100000:2.0:1789185789.353479:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898472192:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.353497:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898472704:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.353503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1789185789.353511:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898472832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.353556:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898472832:12345-0@lo:400:kworker.0 Request processed in 46us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185789.353561:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898473216 00000100:00100000:3.0:1789185789.353566:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789185789.353568:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898473216 00000100:00080000:3.0:1789185789.353594:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789185789.353599:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789185789.353603:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789185789.353606:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185789.353622:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789185789.353633:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185789.353635:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898473216:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185789.353661:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898472448:0@lo:400:kworker.0 00002000:00000024:2.0:1789185789.353666:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185789.353695:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185789.353718:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898473216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (2985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.353725:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c41ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898472960:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.353726:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789185789.353760:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789185789.353765:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c41ed880 x1876096898472832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185789.353776:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898472832:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.353797:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898471552:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.353815:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898473216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185789.353817:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898472064:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.353836:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898472576:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.353852:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898471936 00000100:00100000:3.0:1789185789.353857:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898473088:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.353858:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898471936 00000100:00100000:2.0:1789185789.353893:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789185789.353896:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898471424:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.353929:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898471936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.353942:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898472448 00000100:00100000:3.0:1789185789.353947:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898472448 00000100:00100000:2.0:1789185789.353979:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898471936:12345-0@lo:400:kworker.0 Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185789.353986:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789185789.354006:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898473344 00000100:00100000:2.0:1789185789.354010:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898473344 00000100:00100000:2.0:1789185789.354031:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789185789.354037:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898473344:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185789.354061:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898472960 00000004:00000024:2.0:1789185789.354066:0:6518:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789185789.354067:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898472960 00000100:00100000:3.0:1789185789.354100:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789185789.354106:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898472448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.354138:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898472448:12345-0@lo:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.354144:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789185789.354154:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789185789.354160:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898472960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.354253:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898472960:12345-0@lo:400:kworker.0 Request processed in 93us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.354260:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1789185789.354279:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185789.354334:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898471936:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.354345:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898472448:0@lo:400:kworker.0 00000100:00100000:3.0:1789185789.354354:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c41ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898472960:0@lo:400:kworker.0 00000100:00100000:2.0:1789185789.356902:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898473344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2855us (3462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185789.356932:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789185789.357519:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898473344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185789.360862:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185789.361064:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898471808 00000100:00100000:3.0:1789185789.361153:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898471808 00000100:00100000:3.0:1789185789.361229:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789185789.361241:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898471808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185789.361715:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185789.363226:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898471808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1978us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185789.363243:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789185789.363856:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898471808:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789185789.864662:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000001:00080000:2.0:1789185789.864680:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1789185789.864692:0:6490:0:(genops.c:885:class_export_put()) final put ffff98f1c3523800/cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000001:00100000:2.0:1789185789.864765:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000001:00080000:2.0:1789185789.864770:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1789185789.864780:0:6490:0:(genops.c:885:class_export_put()) final put ffff98f1c316f000/f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:0.0:1789185789.870430:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c3523800/cc75c41c-3996-44b9-8c8f-b4e6d0f7796c for lustre-MDT0000 00000020:00000080:0.0:1789185789.870535:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c3523000 for lustre-MDT0000 00000020:00000080:2.0:1789185789.882088:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c316f000/f993ea83-7802-4340-a17e-bffdbb8158b1 for lustre-MDT0000 00000020:00000080:2.0:1789185789.882174:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c3169000 for lustre-MDT0000 00010000:00010000:2.0:1789185790.249859:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185790.886493:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185790.886517:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898473472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185790.886590:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185790.886698:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898473472 00000100:00100000:3.0:1789185790.886710:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898473472 00000100:00100000:3.0:1789185790.886773:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789185790.886784:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898473472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185790.886824:0:7759:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789185790.886873:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898473472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185790.886880:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789185790.887144:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898473472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185791.272577:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185791.910827:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185791.910849:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898473600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185791.910934:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185791.910992:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185791.911001:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898473728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185791.911037:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185791.911067:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898473600 00000100:00100000:0.0:1789185791.911075:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898473600 00000100:00100000:0.0:1789185791.911123:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898473728 00000100:00100000:0.0:1789185791.911126:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898473728 00000100:00100000:0.0:1789185791.911146:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789185791.911161:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898473600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185791.911189:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789185791.911233:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898473600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185791.911239:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789185791.911384:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789185791.911391:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898473728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185791.911402:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789185791.911439:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898473728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185791.911446:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1789185791.911466:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185791.911501:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898473600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185791.911763:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898473728:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1789185791.917587:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:0.0:1789185791.917600:0:9508:0:(genops.c:885:class_export_put()) final put ffff98f1c365d000/f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:0.0:1789185791.917635:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c365d000/f993ea83-7802-4340-a17e-bffdbb8158b1 for lustre-OST0001 00000020:00000080:0.0:1789185791.917707:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c30fe800 for lustre-OST0001 00000001:00100000:1.0:1789185791.917761:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:1.0:1789185791.917771:0:8423:0:(genops.c:885:class_export_put()) final put ffff98f1c37b7000/f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:0.0:1789185791.918145:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c37b7000/f993ea83-7802-4340-a17e-bffdbb8158b1 for lustre-OST0000 00000020:00000080:0.0:1789185791.918185:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2d8be7000 for lustre-OST0000 00000001:00100000:1.0:1789185791.922717:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000001:00080000:1.0:1789185791.922735:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1789185791.922741:0:7444:0:(genops.c:885:class_export_put()) final put ffff98f1c36a6000/cc75c41c-3996-44b9-8c8f-b4e6d0f7796c 00000001:00100000:1.0:1789185791.922774:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f993ea83-7802-4340-a17e-bffdbb8158b1 00000001:00080000:1.0:1789185791.922781:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1789185791.922784:0:7444:0:(genops.c:885:class_export_put()) final put ffff98f1c316e800/f993ea83-7802-4340-a17e-bffdbb8158b1 00000020:00000080:2.0:1789185791.923250:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c36a6000/cc75c41c-3996-44b9-8c8f-b4e6d0f7796c for lustre-MDT0001 00000020:00000080:2.0:1789185791.923507:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c316e800/f993ea83-7802-4340-a17e-bffdbb8158b1 for lustre-MDT0001 00000020:00000080:2.0:1789185791.925754:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c36a3800 for lustre-MDT0001 00000020:00000080:2.0:1789185791.925770:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c310d000 for lustre-MDT0001 00000020:01000004:2.0:1789185791.986839:0:15166:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789185792.012243:0:15166:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789185792.012372:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.012389:0:15166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.012397:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.012405:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.012431:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789185792.012437:0:15166:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789185792.012478:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789185792.012483:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789185792.012492:0:15166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1789185792.012493:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185792.012505:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789185792.012518:0:15166:0:(import.c:65:import_set_state_nolock()) ffff98f30018b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789185792.012529:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a2a00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:1.0:1789185792.012537:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185792.012549:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789185792.012558:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185792.012563:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898473856:0@lo:39:umount.0 10000000:01000000:1.0:1789185792.012593:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789185792.012597:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789185792.012601:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789185792.012648:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185792.012658:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185792.012672:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789185792.012706:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185792.012713:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2a00/0xda5c730d5a72e0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72e11 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185792.012731:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185792.012734:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185792.012736:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185792.012758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898473984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185792.013079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185792.013725:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898473984 00000100:00100000:2.0:1789185792.013736:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898473984 00000100:00100000:2.0:1789185792.013810:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789185792.013834:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3638:x1876096898473984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185792.013850:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185792.013868:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031400/0xda5c730d5a72e11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72e0a expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.013885:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185792.013954:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3638:x1876096898473984:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185792.013961:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185792.014968:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898473856 00000100:00100000:3.0:1789185792.014982:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898473856 00000100:00100000:1.0:1789185792.015525:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898473984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185792.015968:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789185792.015984:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876096898473856:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789185792.016039:0:6512:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a7296b 00000100:00080000:3.0:1789185792.016051:0:6512:0:(import.c:65:import_set_state_nolock()) ffff98f2c2af0800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789185792.016165:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3634:x1876096898473856:12345-0@lo:39:umount.0 Request processed in 186us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185792.016173:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:3.0:1789185792.016186:0:6512:0:(genops.c:885:class_export_put()) final put ffff98f2e65a2800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789185792.016217:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789185792.016227:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2e65a2800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789185792.016286:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2c2af0800 for lustre-MDT0000 00000100:00080000:3.0:1789185792.016325:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f30018b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789185792.016353:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898473856:0@lo:39:umount.0 00000100:00080000:2.0:1789185792.017719:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789185792.017728:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789185792.017734:0:15166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789185792.018776:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018793:0:15166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018801:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018808:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018836:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185792.018843:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018850:0:15166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018872:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018878:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018903:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789185792.018938:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018944:0:15166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018949:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018955:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018967:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789185792.018973:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018979:0:15166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.018985:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.019003:0:15166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185792.019015:0:15166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789185792.019030:0:15166:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789185792.019058:0:15166:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789185792.019062:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789185792.019067:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789185792.019072:0:15166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1789185792.019080:0:15166:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98f1c30f9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789185792.019087:0:15166:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98f301c23800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789185792.019091:0:15166:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98f2faf75800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789185792.019095:0:15166:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff98f2faf8f800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789185792.019101:0:15166:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff98f2c3ec99c0) has exports, disconnecting them 00000020:00080000:2.0:1789185792.019105:0:15166:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f1c30f9800), last request at 1789185789 00000020:00000080:2.0:1789185792.019112:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72c89 00000100:00080000:2.0:1789185792.019130:0:15166:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fa000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789185792.019194:0:15166:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f1c30f9800): rc 0 00000020:00000080:2.0:1789185792.019198:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f1c30f9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789185792.019210:0:15166:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f301c23800), last request at 1789185789 00000020:00000080:2.0:1789185792.019213:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72b55 00000100:00080000:2.0:1789185792.019220:0:15166:0:(import.c:65:import_set_state_nolock()) ffff98f301c26000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789185792.019226:0:15166:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f301c23800): rc 0 00000020:00000080:2.0:1789185792.019229:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f301c23800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789185792.019232:0:15166:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f2faf75800), last request at 1789185538 00000020:00000080:2.0:1789185792.019235:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72a52 00000100:00080000:2.0:1789185792.019245:0:15166:0:(import.c:65:import_set_state_nolock()) ffff98f2faf73800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789185792.019251:0:15166:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f2faf75800): rc 0 00000020:00000080:2.0:1789185792.019253:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2faf75800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789185792.019258:0:15166:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f2faf8f800), last request at 1789185538 00000020:00000080:2.0:1789185792.019261:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72a13 00000100:00080000:2.0:1789185792.019264:0:15166:0:(import.c:65:import_set_state_nolock()) ffff98f2faf72800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789185792.019271:0:15166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1789185792.019353:0:15166:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f2faf8f800): rc 0 00000004:00000080:2.0:1789185792.019360:0:15166:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb21ac1c43ae0 00000100:00080000:2.0:1789185792.019378:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789185792.019382:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1789185792.020231:0:15166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789185792.020258:0:15166:0:(import.c:65:import_set_state_nolock()) ffff98f2faf8a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789185792.021578:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789185792.021598:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021614:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185792.021619:0:9518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021631:0:9518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185792.021640:0:9518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185792.021646:0:9518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789185792.021649:0:9518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789185792.021653:0:9518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789185792.021704:0:9518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021711:0:9518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185792.021753:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021759:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f300dde400/0xda5c730d5a72e18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72e1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021774:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789185792.021778:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021803:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185792.021807:0:9518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021815:0:9518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185792.021822:0:9518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185792.021826:0:9518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789185792.021829:0:9518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789185792.021831:0:9518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789185792.021847:0:9518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021853:0:9518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185792.021859:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021866:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8200/0xda5c730d5a72d0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72d15 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021877:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185792.021881:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021887:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dbe00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185792.021890:0:9518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021903:0:9518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185792.021942:0:9518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185792.021947:0:9518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789185792.021949:0:9518:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789185792.021951:0:9518:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789185792.021966:0:9518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021972:0:9518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185792.021988:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.021994:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30dbe00/0xda5c730d5a73072 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a73079 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.022004:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185792.022008:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.022013:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185792.022016:0:9518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.022034:0:9518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185792.022051:0:9518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185792.022056:0:9518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789185792.022058:0:9518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789185792.022060:0:9518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789185792.022074:0:9518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.022081:0:9518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185792.022087:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.022094:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3800/0xda5c730d5a728ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a728d1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.022118:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185792.022121:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185792.022125:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185792.022138:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185792.022163:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898474368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185792.022175:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185792.022255:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185792.022355:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185792.022479:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898474368 00000100:00100000:0.0:1789185792.022490:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898474368 00000100:00100000:0.0:1789185792.022563:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185792.022574:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3636:x1876096898474368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185792.022592:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185792.022612:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddee00/0xda5c730d5a72d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72d0e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185792.022638:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185792.022682:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3636:x1876096898474368:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185792.022690:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00000080:0.0:1789185792.022725:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c30f9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789185792.022774:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f301c23800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789185792.022798:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2faf75800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789185792.022821:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c30fa000 for lustre-MDT0000 00000020:00000080:0.0:1789185792.022826:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f301c26000 for lustre-MDT0000 00000020:00000080:0.0:1789185792.023079:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2faf73800 for lustre-MDT0000 00000100:00100000:3.0:1789185792.024235:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898474368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185792.024275:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185792.024286:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898474240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185792.024339:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185792.024385:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898474496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185792.024443:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185792.024477:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185792.024484:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898474624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185792.024488:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898474240 00000100:00100000:1.0:1789185792.024504:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898474240 00000100:00100000:3.0:1789185792.024512:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185792.024574:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898474496 00000100:00100000:1.0:1789185792.024578:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898474496 00000100:00100000:1.0:1789185792.024603:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898474624 00000100:00100000:1.0:1789185792.024606:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898474624 00000100:00100000:1.0:1789185792.024628:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789185792.024638:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+24:3636:x1876096898474240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185792.024669:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185792.024689:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddfe00/0xda5c730d5a72e1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72e18 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185792.024710:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185792.024718:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185792.024731:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9010c27d-11d2-44c0-a2e4-e8975764c875+23:3637:x1876096898474496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185792.024746:0:10394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185792.024765:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73079 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a73072 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185792.024782:0:10394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185792.024800:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+22:3636:x1876096898474240:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185792.024810:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789185792.024836:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789185792.024843:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+21:3637:x1876096898474624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185792.024853:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185792.024863:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031200/0xda5c730d5a728d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a728ca expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185792.024874:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1789185792.026812:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789185792.026821:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1789185792.026840:0:15166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789185792.030669:0:15166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789185792.030708:0:15166:0:(import.c:65:import_set_state_nolock()) ffff98f300ec3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789185792.030724:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789185792.030729:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1789185792.030743:0:15166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789185792.030806:0:15166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789185792.030814:0:15166:0:(import.c:65:import_set_state_nolock()) ffff98f2c3eb7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789185792.030892:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff98f2c3ec99c0) has no exports 00000100:00100000:2.0:1789185792.032420:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898474112:0@lo:39:umount.0 00000100:00100000:1.0:1789185792.032791:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898474240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789185792.032879:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9010c27d-11d2-44c0-a2e4-e8975764c875+20:3637:x1876096898474624:12345-0@lo:103:ldlm_bl.0 Request processed in 8035us (8370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185792.032890:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789185792.033110:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3637:x1876096898474496:12345-0@lo:103:ldlm_bl.0 Request processed in 8371us (8668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185792.033132:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185792.033676:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898474624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185792.033690:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898474496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185792.034554:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185792.034746:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898474112 00000100:00100000:1.0:1789185792.034756:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898474112 00000100:00100000:1.0:1789185792.034810:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789185792.034819:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1876096898474112:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789185792.034853:0:6517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72aad 00000100:00080000:1.0:1789185792.034864:0:6517:0:(import.c:65:import_set_state_nolock()) ffff98f2faf71800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789185792.034886:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789185792.035249:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898474752:0@lo:9:umount.0 00000100:00100000:2.0:1789185792.045685:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185792.045750:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898474880:0@lo:9:umount.0 00000100:00100000:2.0:1789185792.045782:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185792.047431:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898474752 00000100:00100000:2.0:1789185792.047444:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898474752 00000100:00100000:2.0:1789185792.047512:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898474880 00000100:00100000:2.0:1789185792.047516:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898474880 00000100:00100000:2.0:1789185792.047562:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789185792.047572:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1876096898474752:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789185792.047617:0:8429:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72bfd 00000100:00080000:2.0:1789185792.047628:0:8429:0:(import.c:65:import_set_state_nolock()) ffff98f300ec2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789185792.047676:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789185792.047717:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789185792.047740:0:14734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1876096898474880:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789185792.047777:0:14734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72d4d 00000100:00080000:3.0:1789185792.047803:0:14734:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fb800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789185792.047865:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3634:x1876096898474752:12345-0@lo:9:umount.0 Request processed in 292us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185792.047875:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789185792.047941:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f300ec3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789185792.047952:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789185792.047954:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789185792.047958:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898474752:0@lo:9:umount.0 00000001:00000004:3.0:1789185792.048776:0:14734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:0.0:1789185792.048984:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789185792.049114:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185792.050028:0:14734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3634:x1876096898474880:12345-0@lo:9:umount.0 Request processed in 2280us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185792.050042:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:3.0:1789185792.050088:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185792.050096:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789185792.050163:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c3eb7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789185792.050182:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789185792.050184:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789185792.050188:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898474880:0@lo:9:umount.0 00000100:00100000:1.0:1789185792.053386:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3634:x1876096898474112:12345-0@lo:39:umount.0 Request processed in 18557us (18827us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789185792.053417:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1789185792.056040:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2faf8a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789185792.056059:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898474112:0@lo:39:umount.0 00000020:00080000:3.0:1789185792.071763:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff98f2c3ec99c0) has no exports 00000020:00000080:3.0:1789185792.206114:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72925 00000020:00000080:3.0:1789185792.206131:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2c6ff1000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789185792.206206:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789185792.206340:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c6ff1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789185792.206353:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789185792.206373:0:15166:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789185792.206382:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff98f2c6fd0000) has no exports 00000020:00000080:2.0:1789185792.210211:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a7291e 00000020:00000080:2.0:1789185792.210229:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2c777b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789185792.210307:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789185792.210321:0:15166:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789185792.210325:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2f2753800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789185792.210328:0:15166:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f2753800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789185792.210375:0:15166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789185792.211050:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c777b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1789185792.296229:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185792.806643:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789185793.321157:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185794.342221:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185794.470624:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898475008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185794.470708:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185794.471610:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898475008 00000100:00100000:2.0:1789185794.471619:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898475008 00000100:00100000:2.0:1789185794.471664:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789185794.471671:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1876096898475008:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1789185794.471680:0:6518:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789185794.471699:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898475136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185794.471724:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1876096898475008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (1017us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789185794.471730:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185794.471731:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789185794.471767:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898475136 00000100:00100000:1.0:1789185794.471771:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898475136 00000100:00100000:1.0:1789185794.471811:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789185794.471818:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898475136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185794.471843:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789185794.471896:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898475136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185794.471903:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1789185794.471937:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185794.471987:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898475136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185794.472013:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185794.472021:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898475264:0@lo:400:kworker.0 00000100:00100000:1.0:1789185794.472050:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185794.472081:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898475264 00000100:00100000:1.0:1789185794.472085:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898475264 00000100:00100000:1.0:1789185794.472124:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1789185794.472130:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3638:x1876096898475264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185794.472166:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2ce1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9010c27d-11d2-44c0-a2e4-e8975764c875+19:3638:x1876096898475264:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185794.472186:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1789185794.472219:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9010c27d-11d2-44c0-a2e4-e8975764c875:3638:1876096898475264:0@lo:400:kworker.0 00000100:02020000:0.0:1789185794.472422:0:3635:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1789185794.473856:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898475776:0@lo:400:kworker.0 00000100:00100000:3.0:1789185794.473947:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185794.473997:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789185794.474004:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898475392:0@lo:400:kworker.0 00000100:00100000:3.0:1789185794.474032:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185794.474052:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898475904:0@lo:400:kworker.0 00000100:00100000:3.0:1789185794.474072:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185794.474122:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898475392 00000100:00100000:3.0:1789185794.474129:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898475392 00000100:00100000:3.0:1789185794.474166:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898475904 00000100:00100000:3.0:1789185794.474169:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898475904 00000100:00100000:3.0:1789185794.474186:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789185794.474192:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876096898475392:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789185794.474199:0:6513:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789185794.474237:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876096898475392:12345-0@lo:400:kworker.0 Request processed in 43us (203us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789185794.474243:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789185794.474259:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789185794.474263:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876096898475904:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789185794.474282:0:6513:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789185794.474308:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876096898475904:12345-0@lo:400:kworker.0 Request processed in 44us (236us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789185794.474315:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1789185794.474352:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789185794.474357:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98f2d26c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789185794.474361:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789185794.474440:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898475648:0@lo:400:kworker.0 00000100:00100000:1.0:1789185794.474469:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185794.474491:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789185794.474497:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898475520:0@lo:400:kworker.0 00000100:00100000:1.0:1789185794.474518:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185794.474535:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898476032:0@lo:400:kworker.0 00000100:00100000:1.0:1789185794.474554:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185794.474578:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898475648 00000100:00100000:1.0:1789185794.474582:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898475648 00000100:00100000:1.0:1789185794.474614:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898475520 00000100:00100000:1.0:1789185794.474618:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898475520 00000100:00100000:1.0:1789185794.474626:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898476032 00000100:00100000:1.0:1789185794.474628:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898476032 00000100:00100000:1.0:1789185794.474641:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789185794.474647:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898475648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185794.474688:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898475648:12345-0@lo:400:kworker.0 Request processed in 41us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185794.474694:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789185794.474707:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789185794.474713:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898476032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185794.474737:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898476032:12345-0@lo:400:kworker.0 Request processed in 25us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185794.474742:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789185794.474763:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789185794.474767:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1876096898475520:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789185794.474771:0:9473:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789185794.474792:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1876096898475520:12345-0@lo:400:kworker.0 Request processed in 24us (273us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789185794.474797:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789185794.474811:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185794.474826:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789185794.474829:0:3636:0:(import.c:65:import_set_state_nolock()) ffff98f1c207d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789185794.474832:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789185794.474836:0:3636:0:(import.c:65:import_set_state_nolock()) ffff98f1c207d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789185794.474840:0:3636:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 200 00000100:00080000:1.0:1789185794.474848:0:3636:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f1c207d800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185794.474872:0:3636:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b0380 x1876096898476160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185794.474891:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898475520:0@lo:400:kworker.0 00010000:00080000:1.0:1789185794.474904:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b0380 x1876096898476032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185794.474934:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898476032:0@lo:400:kworker.0 00010000:00080000:1.0:1789185794.474946:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b3b80 x1876096898475648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185794.474952:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898475648:0@lo:400:kworker.0 00000100:00100000:2.0:1789185794.475444:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898475776 00000100:00100000:2.0:1789185794.475450:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898475776 00000100:00100000:2.0:1789185794.475498:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789185794.475507:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898475776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185794.475550:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898475776:12345-0@lo:400:kworker.0 Request processed in 45us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185794.475556:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789185794.475587:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898476160:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789185794.475614:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185794.475641:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898476160 00000100:00100000:2.0:1789185794.475645:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898476160 00000100:00100000:2.0:1789185794.475661:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789185794.475666:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1876096898476160:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789185794.475680:0:9473:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789185794.475716:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1876096898476160:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 49us (101us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789185794.475721:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1789185794.475744:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c207d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789185794.475748:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789185794.475761:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898476160:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1789185794.478208:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185794.493221:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789185794.493230:0:3635:0:(import.c:65:import_set_state_nolock()) ffff98f2ce17e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789185794.493235:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789185794.493241:0:3635:0:(import.c:65:import_set_state_nolock()) ffff98f2ce17e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185794.493245:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 177 00000100:00080000:0.0:1789185794.493262:0:3635:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98f2ce17e800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185794.493303:0:3635:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c3487800 x1876096898476288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185794.496664:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898476288:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789185794.496743:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185794.497964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898476288 00000100:00100000:1.0:1789185794.498007:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898476288 00000100:00100000:1.0:1789185794.498050:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789185794.498059:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898476288:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789185794.498078:0:6517:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789185794.498163:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898476288:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 103us (1418us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789185794.498170:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1789185794.498484:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2ce17e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185794.498496:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185794.498500:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898476288:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1789185794.543987:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98f2d26c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185794.544002:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 177 00000100:00080000:3.0:1789185794.544390:0:3637:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98f2d26c8000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185794.544452:0:3637:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2c87b8a80 x1876096898476416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185794.544523:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876096898476416:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789185794.544587:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185794.544710:0:8147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898476416 00000100:00100000:1.0:1789185794.544720:0:8147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898476416 00000100:00100000:1.0:1789185794.544761:0:8147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789185794.544769:0:8147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1876096898476416:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789185794.544786:0:8147:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789185794.544850:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898475392:0@lo:400:kworker.0 00000100:00080000:3.0:1789185794.544876:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789185794.544879:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789185794.544884:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789185794.544888:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185794.544891:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 222 00000100:00080000:3.0:1789185794.544897:0:3637:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f1c316b800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185794.544940:0:3637:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2c87b9180 x1876096898476544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185794.547041:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898476544:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789185794.547110:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185794.547228:0:9473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898476544 00000100:00100000:2.0:1789185794.547236:0:9473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898476544 00000100:00100000:2.0:1789185794.547274:0:9473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789185794.547281:0:9473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1876096898476544:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1789185794.547298:0:9473:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789185794.547339:0:9473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1876096898476544:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 57us (229us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789185794.547346:0:9473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789185794.553499:0:8147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1876096898476416:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 8715us (8897us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789185794.553528:0:8147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1789185794.553818:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2d26c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185794.553825:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185794.553829:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876096898476416:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1789185794.553861:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185794.553864:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185794.553868:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898476544:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789185794.562878:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898475904:0@lo:400:kworker.0 00000100:00100000:2.0:1789185794.570832:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898475776:0@lo:400:kworker.0 00010000:00010000:3.0:1789185795.366163:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185796.391418:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185797.032725:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898476672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185797.032817:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185797.033239:0:8993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898476672 00000100:00100000:0.0:1789185797.033247:0:8993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898476672 00000100:00100000:0.0:1789185797.033318:0:8993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789185797.033330:0:8993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898476672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185797.033361:0:8993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789185797.033414:0:8993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898476672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185797.033421:0:8993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789185797.033471:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898476672:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789185797.034326:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789185797.416258:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789185797.549380:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789185797.549402:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789185797.549410:0:7444:0:(genops.c:885:class_export_put()) final put ffff98f2faf8c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789185797.549981:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2faf8c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789185797.550482:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2faf71800 for lustre-MDT0001 00000001:00100000:1.0:1789185797.552291:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789185797.552304:0:8423:0:(genops.c:885:class_export_put()) final put ffff98f300ec4800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789185797.552509:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789185797.552532:0:9508:0:(genops.c:885:class_export_put()) final put ffff98f1c30f8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789185797.552551:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300ec4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789185797.552607:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c30f8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789185797.552657:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f300ec2000 for lustre-OST0000 00000020:00000080:2.0:1789185797.552666:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c30fb800 for lustre-OST0001 00000001:00100000:1.0:1789185797.553750:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789185797.553757:0:6490:0:(genops.c:885:class_export_put()) final put ffff98f2faf8f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789185797.554141:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2faf8f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789185797.554300:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2faf72800 for lustre-MDT0000 00000020:01000000:0.0:1789185798.246115:0:15166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f1c31a5960 - data ffff98f2dcdb06c0/ffff98f1c32a4400 00000020:01000000:0.0:1789185798.246346:0:15166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f2c7cad240 - data ffff98f2dcd2f1b0/ffff98f2e7add800 00000001:00000004:0.0:1789185798.261325:0:15166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1789185798.361359:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789185798.361368:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789185798.361384:0:15166:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98f1c19b1c00 x1876096898474112/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789185802 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185798.361409:0:15166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789185798.374744:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789185798.374757:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789185798.374786:0:15166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789185798.374790:0:15166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789185798.376989:0:8471:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789185798.377001:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1789185798.377035:0:8471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789185798.380300:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789185798.380310:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789185798.380335:0:15166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789185798.380338:0:15166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789185798.383795:0:9822:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789185798.383810:0:9822:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789185798.383832:0:9822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789185798.391715:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a728ed 00000020:00000080:1.0:1789185798.391736:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2f271a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789185798.393275:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f271a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789185798.420300:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72902 00000020:00000080:0.0:1789185798.420316:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2f27aa000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789185798.420340:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789185798.420346:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185798.420357:0:15166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789185798.420362:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff98f2c3eccd40) has no exports 00000020:00000080:3.0:1789185798.420377:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f27aa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1789185798.420734:0:15166:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789185798.420747:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72d38 00000020:00000080:0.0:1789185798.420754:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f1c3169800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789185798.420768:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789185798.420773:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185798.420784:0:15166:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789185798.420788:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff98f1c34e8000) has no exports 00000020:00000080:0.0:1789185798.420796:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72d31 00000020:00000080:0.0:1789185798.420801:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2c3eb4000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789185798.420865:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c3169800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789185798.420888:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c3eb4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789185798.421573:0:15166:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789185798.421582:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789185798.421587:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789185798.421594:0:15166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789185798.421611:0:15166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789185798.421650:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185798.421660:0:15166:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789185798.421665:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72bf6 00000020:00000080:0.0:1789185798.421671:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f300ec3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789185798.421675:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789185798.421679:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185798.421683:0:15166:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789185798.421687:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff98f300180000) has no exports 00000020:00000080:0.0:1789185798.421692:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72bef 00000020:00000080:0.0:1789185798.421695:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f300ec0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789185798.422098:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2c3eb7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789185798.422115:0:38:0:(genops.c:885:class_export_put()) final put ffff98f2c3eb4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789185798.422118:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c3eb4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789185798.422132:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:01000000:0.0:1789185798.422139:0:15166:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789185798.422146:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789185798.422149:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789185798.422154:0:15166:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789185798.422156:0:15166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789185798.422204:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185798.422211:0:15166:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789185798.422224:0:15166:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789185798.422231:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72aa6 00000020:00000080:0.0:1789185798.422237:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2f271c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789185798.422254:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789185798.422259:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185798.422266:0:15166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789185798.422268:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff98f3001819c0) has no exports 00000020:00000080:3.0:1789185798.422271:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300ec3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789185798.422274:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72a9f 00000020:00000080:0.0:1789185798.422284:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2faf8c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789185798.422288:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300ec0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789185798.422322:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f300ec3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789185798.422328:0:38:0:(genops.c:885:class_export_put()) final put ffff98f300ec4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789185798.422331:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300ec4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789185798.422348:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789185798.422444:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f271c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789185798.422463:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2faf8c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789185798.433031:0:15166:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789185798.433041:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789185798.433046:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789185798.433057:0:15166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789185798.433159:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2faf8a000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789185798.433224:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185798.433258:0:15166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789185798.433267:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2faf8e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789185798.433281:0:15166:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2faf8e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789185798.433299:0:15166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789185798.433431:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185798.433435:0:15166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789185798.433438:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2f271a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789185798.433440:0:15166:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f271a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789185798.433444:0:15166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789185798.433596:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72909 00000020:00000080:0.0:1789185798.433605:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2f27a9800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789185798.433612:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789185798.433616:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185798.433622:0:15166:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789185798.433626:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff98f2f27a3380) has no exports 00000020:00000080:0.0:1789185798.433656:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185798.433662:0:15166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789185798.433669:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72910 00000020:00000080:1.0:1789185798.433675:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f27a9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789185798.433676:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2f27a9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789185798.433695:0:38:0:(genops.c:885:class_export_put()) final put ffff98f2f271b800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789185798.433700:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f271b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:0.0:1789185798.433712:0:15166:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2e7ae1000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789185798.433719:0:15166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2e7ae1000 3 00000020:01000000:1.0:1789185798.433720:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1789185798.433728:0:15166:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f2e7ae1000 from lustre-MDT0000 00000020:00000080:0.0:1789185798.433762:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185798.433766:0:15166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789185798.433769:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2f271f000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789185798.433772:0:15166:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f271f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789185798.433791:0:15166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1789185798.433885:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f27a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789185798.433888:0:15166:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789185798.433895:0:15166:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789185798.434336:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789185798.434341:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185798.434345:0:15166:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789185798.434359:0:15166:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff98f2c7c45800 9010c27d-11d2-44c0-a2e4-e8975764c875 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789185798.434366:0:15166:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff98f2c3ecb380) has exports, disconnecting them 00000020:00080000:0.0:1789185798.434371:0:15166:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98f2c7c45800), last request at 1789185516 00000020:00000080:0.0:1789185798.434388:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a728a7 00000020:00010000:0.0:1789185798.434392:0:15166:0:(genops.c:1920:obd_stale_export_put()) Put export ffff98f2c7c45800: total 0 00000100:00080000:0.0:1789185798.434397:0:15166:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c46800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789185798.434423:0:15166:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f2c7c45800): rc 0 00000020:00080000:0.0:1789185798.434427:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff98f2c3ecb380) has no exports 00000020:00010000:1.0:1789185798.434729:0:9517:0:(genops.c:1906:obd_stale_export_get()) Get export ffff98f2c7c45800: total 0 00010000:00010000:1.0:1789185798.434785:0:9517:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98f2c7c45800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789185798.434819:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300ddea00/0xda5c730d5a72de7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72de0 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.434838:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0030e00/0xda5c730d5a72dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72dd2 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.434853:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c13a3a00/0xda5c730d5a729b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a729b1 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.434871:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f300dde000/0xda5c730d5a7304f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a73048 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.434881:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c1bf8c00/0xda5c730d5a72df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72dee expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.434891:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a729aa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a729a3 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.435254:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c13a3e00/0xda5c730d5a72e03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72dfc expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185798.436099:0:6507:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff98f2e6505400:6507] 2 exiting: rc = 0 00010000:00010000:1.0:1789185798.436798:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30da200/0xda5c730d5a7306b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a73064 expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.436814:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166d200/0xda5c730d5a72ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72cc8 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.436830:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c30db800/0xda5c730d5a7305d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a73056 expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.436848:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c13a3400/0xda5c730d5a72dbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72db6 expref: 4 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.436862:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a72dcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72dc4 expref: 3 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.436875:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031800/0xda5c730d5a72e2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xda5c730d5a72e26 expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185798.436887:0:9517:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98f2c7c45800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789185798.437354:0:9517:0:(genops.c:885:class_export_put()) final put ffff98f2c7c45800/9010c27d-11d2-44c0-a2e4-e8975764c875 00010000:00010000:1.0:1789185798.437414:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185798.437417:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185798.437420:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789185798.444502:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c7c45800/9010c27d-11d2-44c0-a2e4-e8975764c875 for MGS 00000020:00000080:0.0:1789185798.445646:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2c7c46800 for MGS 00000100:00100000:0.0:1789185798.468368:0:6505:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff98f2e6504000:6505] 0 exiting: rc = 1 00000100:00100000:0.0:1789185798.468543:0:6506:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff98f2e6505a00:6506] 1 exiting: rc = 0 00000100:00100000:1.0:1789185798.468696:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468708:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468714:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468721:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468727:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468733:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468738:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468764:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468770:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468776:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468781:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468787:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468793:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468798:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468803:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468809:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468813:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468819:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468825:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468831:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468836:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468841:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468846:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468852:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468857:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468864:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468868:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468874:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468880:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468885:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468891:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468937:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468943:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468950:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468956:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468962:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468968:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468975:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468981:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468987:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.468991:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469015:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469027:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469032:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469037:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469042:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469047:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469052:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469057:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469062:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469067:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469073:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469079:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469084:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469089:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469094:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469099:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469105:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469110:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469115:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469120:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469126:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469131:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185798.469137:0:15166:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789185798.480398:0:15166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f1c31a5840 - data ffff98f2dcedb948/ffff98f1c2e29800 00000020:01000000:1.0:1789185798.480598:0:15166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f2c7cad300 - data ffff98f2dcccc000/ffff98f2c6089400 00000020:00000080:0.0:1789185798.481275:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72892 00000020:00000080:0.0:1789185798.481285:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2c7f98800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789185798.481300:0:15166:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2e7ae1000 from MGS, refs=2 00000020:01000004:0.0:1789185798.481303:0:15166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2e7ae1000 2 00000020:01000004:0.0:1789185798.481306:0:15166:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f2e7ae1000 from MGS 00000020:00000080:0.0:1789185798.481328:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185798.481337:0:15166:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789185798.481339:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2c7f9b000/MGS 00000020:00000080:0.0:1789185798.481342:0:15166:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c7f9b000/MGS for MGS 00000020:01000000:0.0:1789185798.481348:0:15166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789185798.481410:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789185798.481414:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185798.481420:0:15166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789185798.481426:0:15166:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98f300188800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789185798.481432:0:15166:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff98f300183380) has exports, disconnecting them 00000020:00080000:0.0:1789185798.481436:0:15166:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98f300188800), last request at 1789185517 00000020:00000080:0.0:1789185798.481440:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a7295d 00000020:00000080:1.0:1789185798.481488:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c7f98800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1789185798.481650:0:15166:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f300188800): rc 0 00000020:00000080:0.0:1789185798.481655:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f300188800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789185798.481833:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300188800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:00010000:1.0:1789185798.481996:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:1.0:1789185798.483966:0:15166:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789185798.483975:0:15166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789185798.483980:0:15166:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789185798.483986:0:15166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789185798.484020:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f30018b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789185798.484182:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185798.484200:0:15166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789185798.484205:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2ce17d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789185798.484208:0:15166:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2ce17d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789185798.484213:0:15166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789185798.484309:0:15166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2e7ae1000 1 00000020:00000080:1.0:1789185798.484314:0:15166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72884 00000020:00000080:1.0:1789185798.484320:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2c7f9a000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789185798.484328:0:15166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789185798.484335:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c7f9a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789185798.484343:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185798.484346:0:15166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789185798.484350:0:15166:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff98f2c3ec8000) has no exports 00000020:00000080:1.0:1789185798.614107:0:15166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185798.614122:0:15166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789185798.614128:0:15166:0:(genops.c:885:class_export_put()) final put ffff98f2e7ae2800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789185798.614133:0:15166:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2e7ae2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789185798.614139:0:15166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789185798.614421:0:15166:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f2e7ae7000 00000020:02000400:1.0:1789185798.614554:0:15166:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789185799.467625:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185799.590403:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898476800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185799.590485:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185799.590654:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898476800 00000100:00100000:3.0:1789185799.590663:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898476800 00000100:00100000:3.0:1789185799.590728:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789185799.590738:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898476800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789185799.590770:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789185799.590815:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898476800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185799.590822:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1789185799.590897:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185799.590960:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898476800:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789185799.599103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185799.599110:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789185799.599114:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2ce17e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185799.599123:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1789185799.599128:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185799.599139:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98f2ce17e800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185799.599163:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c3485180 x1876096898477056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185799.599181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185799.599185:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789185799.599187:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2d26c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185799.599190:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1789185799.599193:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185799.599197:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98f2d26c8000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185799.599208:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c3486a00 x1876096898477184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185799.599217:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185799.599221:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789185799.599222:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f1c207d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185799.599236:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1789185799.599239:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185799.599243:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f1c207d800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185799.599255:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c3484380 x1876096898477312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185799.599312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185799.599315:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789185799.599317:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185799.599321:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1789185799.599324:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185799.599328:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f1c316b800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185799.599339:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c3485f80 x1876096898477696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185799.599385:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898477056:0@lo:38:kworker.0 00000100:00100000:0.0:1789185799.599452:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185799.599500:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876096898477184:0@lo:38:kworker.0 00000100:00100000:0.0:1789185799.599530:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185799.599554:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898477312:0@lo:38:kworker.0 00000100:00100000:0.0:1789185799.599577:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185799.599598:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898477696:0@lo:38:kworker.0 00000100:00100000:0.0:1789185799.599618:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185799.599656:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898477568:0@lo:400:kworker.0 00000100:00100000:0.0:1789185799.599682:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185799.599705:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185799.599718:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898477440:0@lo:400:kworker.0 00000100:00100000:0.0:1789185799.599741:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185799.599784:0:7759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898477056 00000100:00100000:0.0:1789185799.599792:0:7759:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898477056 00000100:00100000:0.0:1789185799.599827:0:7759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789185799.599834:0:7759:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1876096898477056:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789185799.599857:0:7759:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789185799.599936:0:7759:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1876096898477056:12345-0@lo:38:kworker.0 Request processed in 101us (484us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789185799.599944:0:7759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789185799.599967:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898477184 00000100:00100000:0.0:1789185799.599971:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898477184 00000100:00100000:0.0:1789185799.599990:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898477312 00000100:00100000:0.0:1789185799.599993:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898477312 00000100:00100000:0.0:1789185799.600000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898477696 00000100:00100000:0.0:1789185799.600002:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898477696 00000100:00100000:0.0:1789185799.600009:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898477440 00000100:00100000:0.0:1789185799.600011:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898477440 00000100:00100000:0.0:1789185799.600046:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789185799.600052:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898477440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185799.600096:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898477440:12345-0@lo:400:kworker.0 Request processed in 44us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185799.600102:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789185799.600115:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789185799.600119:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898477184:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789185799.600128:0:6512:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789185799.600153:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898477184:12345-0@lo:38:kworker.0 Request processed in 33us (623us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789185799.600167:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789185799.600179:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789185799.600184:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898477312:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789185799.600192:0:6512:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789185799.600215:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898477312:12345-0@lo:38:kworker.0 Request processed in 31us (638us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789185799.600220:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789185799.600229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789185799.600233:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898477696:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789185799.600241:0:6512:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789185799.600261:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898477696:12345-0@lo:38:kworker.0 Request processed in 27us (642us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789185799.600266:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789185799.600290:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898477568 00000100:00100000:0.0:1789185799.600298:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898477568 00000100:00100000:0.0:1789185799.600329:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789185799.600335:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898477568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185799.600366:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898477568:12345-0@lo:400:kworker.0 Request processed in 31us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185799.600372:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1789185799.600398:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789185799.600402:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789185799.600425:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff98f1c3485c00 x1876096898477440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185799.600437:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898477440:0@lo:400:kworker.0 00000100:00100000:0.0:1789185799.600460:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898477568:0@lo:400:kworker.0 00000100:00100000:0.0:1789185799.600490:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898477824:0@lo:400:kworker.0 00000100:00100000:0.0:1789185799.600516:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185799.600535:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185799.600541:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898476928:0@lo:400:kworker.0 00000400:00000100:0.0:1789185799.600560:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876096898476928 offset 0 length 224: 4 00000100:00080000:0.0:1789185799.600594:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2ce17e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185799.600598:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185799.600601:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898477056:0@lo:38:kworker.0 00000100:00080000:0.0:1789185799.600608:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2d26c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185799.600611:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185799.600614:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876096898477184:0@lo:38:kworker.0 00000100:00080000:0.0:1789185799.600621:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c207d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185799.600624:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185799.600626:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898477312:0@lo:38:kworker.0 00000100:00080000:0.0:1789185799.600634:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185799.600637:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185799.600640:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898477696:0@lo:38:kworker.0 00000100:00100000:0.0:1789185799.600663:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898477824 00000100:00100000:0.0:1789185799.600667:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898477824 00000100:00100000:0.0:1789185799.600692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789185799.600698:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898477824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185799.600730:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898477824:12345-0@lo:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185799.600743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00080000:0.0:1789185799.600760:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789185799.600776:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff98f1c3487480 x1876096898477824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185799.600787:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898477824:0@lo:400:kworker.0 00010000:00010000:3.0:1789185800.486101:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185801.510808:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185802.025275:0:13812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789185802.150106:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185802.150129:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898477952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185802.150203:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185802.156339:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898477952 00000100:00100000:1.0:1789185802.156359:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898477952 00000100:00100000:1.0:1789185802.156461:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789185802.156474:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898477952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185802.156511:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789185802.158982:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898477952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2495us (8762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185802.159003:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1789185802.159062:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185802.159162:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898477952:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789185802.537513:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789185802.784701:0:15368:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789185802.823824:0:15368:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789185802.823892:0:15368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.823943:0:15368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.823953:0:15368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.823961:0:15368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.823988:0:15368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789185802.823994:0:15368:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789185802.824011:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185802.824018:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789185802.824023:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1789185802.824025:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8e00 already unused, calling callback (ffffffffc131bc20) 00000100:00100000:3.0:1789185802.824028:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 10000000:00010000:2.0:1789185802.824029:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789185802.824034:0:15368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1789185802.824037:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789185802.824039:0:15368:0:(import.c:65:import_set_state_nolock()) ffff98f2d26c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 10000000:00010000:2.0:1789185802.824044:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789185802.824058:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:2.0:1789185802.824058:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789185802.824060:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 10000000:01000000:2.0:1789185802.824061:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:3.0:1789185802.824063:0:15368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789185802.824063:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789185802.824107:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185802.824115:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789185802.824140:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185802.824147:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8e00/0xda5c730d5a72dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72df5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185802.824159:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185802.824161:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185802.824162:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185802.825020:0:15368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825034:0:15368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825041:0:15368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825047:0:15368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825066:0:15368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185802.825071:0:15368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825078:0:15368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825084:0:15368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825090:0:15368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825106:0:15368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789185802.825112:0:15368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825128:0:15368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825134:0:15368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825140:0:15368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825149:0:15368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789185802.825154:0:15368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825160:0:15368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825166:0:15368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825172:0:15368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185802.825179:0:15368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789185802.825182:0:15368:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789185802.825206:0:15368:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789185802.825210:0:15368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789185802.825213:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789185802.825218:0:15368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789185802.825224:0:15368:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff98f1c30fb000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789185802.825236:0:15368:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff98f2f271c800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789185802.825241:0:15368:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff98f30038cd40) has exports, disconnecting them 00000020:00080000:3.0:1789185802.825246:0:15368:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98f1c30fb000), last request at 1789185799 00000020:00000080:3.0:1789185802.825253:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72c90 00000100:00080000:3.0:1789185802.825270:0:15368:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fc800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789185802.825324:0:15368:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f1c30fb000): rc 0 00000020:00000080:3.0:1789185802.825327:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f1c30fb000/lustre-MDT0001-lwp-OST0001_UUID 00000100:00100000:0.0:1789185802.825408:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898478080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185802.825488:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185802.825554:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789185802.825559:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825567:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185802.825571:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825579:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185802.825585:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185802.825591:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789185802.825594:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789185802.825602:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1789185802.825627:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825633:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185802.825647:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825654:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9000/0xda5c730d5a72dfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72e03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825665:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789185802.825668:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825674:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185802.825677:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825685:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185802.825691:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185802.825697:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789185802.825699:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789185802.825700:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789185802.825709:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825715:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185802.825734:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825740:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30db200/0xda5c730d5a72cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a72ccf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825754:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185802.825757:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825763:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185802.825766:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825773:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185802.825779:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185802.825784:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789185802.825786:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789185802.825788:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789185802.825801:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825807:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185802.825812:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825830:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c30da800/0xda5c730d5a73064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a7306b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825848:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185802.825852:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825858:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a2600 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185802.825861:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825868:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185802.825874:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185802.825880:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789185802.825881:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789185802.825883:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789185802.825896:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825902:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185802.825927:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825934:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c13a2600/0xda5c730d5a729b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xda5c730d5a729b8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185802.825946:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185802.825948:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185802.825954:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185802.825965:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898478208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185802.825993:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185802.826021:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789185802.826027:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898478592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185802.826048:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185802.826074:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898478336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185802.826092:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185802.826106:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789185802.826111:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898478464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185802.826130:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185802.826153:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898478080 00000100:00100000:0.0:1789185802.826160:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898478080 00000100:00100000:0.0:1789185802.826188:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898478208 00000100:00100000:0.0:1789185802.826190:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898478208 00000100:00100000:0.0:1789185802.826199:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898478592 00000100:00100000:0.0:1789185802.826201:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898478592 00000100:00100000:0.0:1789185802.826209:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898478336 00000100:00100000:0.0:1789185802.826211:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898478336 00000100:00100000:0.0:1789185802.826218:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898478464 00000100:00100000:0.0:1789185802.826220:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898478464 00000100:00100000:0.0:1789185802.826232:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789185802.826241:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3635:x1876096898478080:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789185802.826247:0:10394:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789185802 with bad export cookie 983411106207180967 00010000:00010000:2.0:1789185802.827350:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185802.827376:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789185802.827384:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1876096898478208:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789185802.827390:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789185802 with bad export cookie 983411106207180967 00000100:00100000:2.0:1789185802.827460:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1876096898478208:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1465us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789185802.827467:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789185802.827508:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789185802.827513:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1876096898478592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789185802.827517:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789185802 with bad export cookie 983411106207180967 00000100:00100000:2.0:1789185802.827545:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1876096898478592:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (1495us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789185802.827563:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789185802.827577:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789185802.827582:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1876096898478336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789185802.827586:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789185802 with bad export cookie 983411106207180967 00000100:00100000:2.0:1789185802.827617:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1876096898478336:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (1524us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789185802.827623:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789185802.827636:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789185802.827640:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1876096898478464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789185802.827644:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789185802 with bad export cookie 983411106207180967 00000100:00100000:2.0:1789185802.827668:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1876096898478464:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (1537us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789185802.827674:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1789185802.828192:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185802.832353:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185802.832448:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789185802.832454:0:3636:0:(import.c:65:import_set_state_nolock()) ffff98f2c6ff6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789185802.832459:0:3636:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00080000:3.0:1789185802.832554:0:15368:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98f2f271c800), last request at 1789185799 00000020:00000080:3.0:1789185802.832565:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72b6a 00000100:00080000:3.0:1789185802.832579:0:15368:0:(import.c:65:import_set_state_nolock()) ffff98f2f27ad800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789185802.832604:0:15368:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f2f271c800): rc 0 00000020:00000080:3.0:1789185802.832607:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2f271c800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789185802.832615:0:15368:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb21ac1667ae0 00000100:00080000:3.0:1789185802.832639:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789185802.832649:0:15368:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff98f1c19b3100 x1876096898475008/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789185810 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185802.832662:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:2.0:1789185802.833378:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c30fb000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1789185802.833432:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f271c800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1789185802.833452:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c30fc800 for lustre-MDT0001 00000020:00000080:2.0:1789185802.833457:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2f27ad800 for lustre-MDT0001 00000100:00080000:3.0:1789185802.835161:0:15368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789185802.835173:0:15368:0:(import.c:65:import_set_state_nolock()) ffff98f2ce17e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789185802.836966:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789185802.836974:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789185802.836992:0:15368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789185802.837054:0:15368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789185802.837088:0:15368:0:(import.c:65:import_set_state_nolock()) ffff98f300f06000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789185802.837110:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789185802.837112:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789185802.837121:0:15368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789185802.837202:0:15368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789185802.837215:0:15368:0:(import.c:65:import_set_state_nolock()) ffff98f1c3109800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789185802.837241:0:15368:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff98f30038cd40) has no exports 00000100:00100000:0.0:1789185802.842004:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3635:x1876096898478080:12345-0@lo:103:ldlm_bl.0 Request processed in 15757us (16509us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789185802.842020:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789185802.842126:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1789185802.854023:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898478720:0@lo:9:umount.0 00000100:00100000:2.0:1789185802.854109:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185802.854154:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898478848:0@lo:9:umount.0 00000100:00100000:2.0:1789185802.854181:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185802.854240:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898478720 00000100:00100000:2.0:1789185802.854248:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898478720 00000100:00100000:2.0:1789185802.854315:0:9819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898478848 00000100:00100000:2.0:1789185802.854319:0:9819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898478848 00000100:00100000:2.0:1789185802.854377:0:9819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789185802.854386:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789185802.854389:0:9819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1876096898478720:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789185802.854400:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1876096898478848:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789185802.854421:0:8430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72cf9 00000020:00000080:2.0:1789185802.854421:0:9819:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72bb7 00000100:00080000:3.0:1789185802.854431:0:8430:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789185802.854432:0:9819:0:(import.c:65:import_set_state_nolock()) ffff98f301c24000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789185802.854473:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:2.0:1789185802.854485:0:9819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789185802.854628:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3634:x1876096898478848:12345-0@lo:9:umount.0 Request processed in 232us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185802.854632:0:9819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3634:x1876096898478720:12345-0@lo:9:umount.0 Request processed in 244us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185802.854640:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789185802.854646:0:9819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:2.0:1789185802.854682:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185802.854688:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789185802.854712:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f300f06000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789185802.854743:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789185802.854747:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789185802.854751:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898478720:0@lo:9:umount.0 00000100:00080000:2.0:1789185802.854763:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c3109800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789185802.854781:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789185802.854783:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789185802.854786:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898478848:0@lo:9:umount.0 00000100:00080000:2.0:1789185802.858092:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1789185802.862056:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185802.867647:0:3636:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.148@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789185802.867653:0:3636:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789185802.867663:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f1c3484000 x1876096898476928/t0(0) o400->MGC192.168.204.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789185815 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185802.867679:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f1c19b1f80 x1876096898478080/t0(0) o103->MGC192.168.204.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789185818 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185802.867688:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758ed80 x1876096898478208/t0(0) o103->MGC192.168.204.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789185818 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185802.867696:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758d500 x1876096898478592/t0(0) o103->MGC192.168.204.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789185818 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185802.867704:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758c000 x1876096898478336/t0(0) o103->MGC192.168.204.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789185818 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185802.867711:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758c700 x1876096898478464/t0(0) o103->MGC192.168.204.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789185818 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789185802.867736:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789185802.867739:0:3636:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789185802.867740:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789185802.868165:0:3637:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98f2c6ff6000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789185802.868211:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898478336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185802.868220:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898476928:0@lo:400:kworker.0 00000100:00100000:0.0:1789185802.868251:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9010c27d-11d2-44c0-a2e4-e8975764c875:3637:1876096898478464:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789185802.869722:0:3635:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98f2c6ff6000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1789185802.869724:0:3636:0:(import.c:65:import_set_state_nolock()) ffff98f2c6ff6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789185802.869736:0:3636:0:(import.c:545:import_select_connection()) MGC192.168.204.148@tcp: connect to NID 0@lo last attempt 156 00000100:00100000:2.0:1789185802.869742:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898475008:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789185802.869774:0:3636:0:(import.c:666:import_select_connection()) MGC192.168.204.148@tcp: import ffff98f2c6ff6000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:2.0:1789185802.869849:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9010c27d-11d2-44c0-a2e4-e8975764c875:3635:1876096898478080:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789185802.870026:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185802.870080:0:3636:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b3480 x1876096898478976/t0(0) o250->MGC192.168.204.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185802.870145:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898478208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185802.870162:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9010c27d-11d2-44c0-a2e4-e8975764c875:3634:1876096898478976:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:1.0:1789185802.870165:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9010c27d-11d2-44c0-a2e4-e8975764c875:3636:1876096898478592:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1789185802.870231:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876096898478976 offset 0 length 520: 4 00000020:00080000:3.0:1789185802.877366:0:15368:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff98f30038cd40) has no exports 00000020:01000000:2.0:1789185802.939384:0:15368:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f300cceb40 - data ffff98f2dcf56438/ffff98f2fa0b5000 00000020:01000000:2.0:1789185802.939539:0:15368:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f2c3eba7e0 - data ffff98f2dcda5948/ffff98f2fa143000 00000001:00000004:2.0:1789185802.969223:0:15368:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1789185803.025171:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789185803.025181:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789185803.025189:0:15368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789185803.034442:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789185803.034452:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1789185803.034475:0:15368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789185803.034478:0:15368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789185803.034682:0:8464:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789185803.034687:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789185803.034750:0:8464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789185803.039525:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789185803.039545:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789185803.039562:0:15368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789185803.039565:0:15368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789185803.040492:0:9817:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789185803.040498:0:9817:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1789185803.040509:0:9817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789185803.047070:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a729d4 00000020:00000080:1.0:1789185803.047083:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2fa18d000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789185803.047171:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2fa18d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789185803.051747:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a729e9 00000020:00000080:1.0:1789185803.051762:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2fa18f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789185803.051780:0:15368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789185803.051787:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185803.051796:0:15368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789185803.051800:0:15368:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff98f30038b380) has no exports 00000020:00000080:3.0:1789185803.053101:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2fa18f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1789185803.053131:0:15368:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789185803.053144:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72cf2 00000020:00000080:1.0:1789185803.053152:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f1c310a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789185803.053209:0:15368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789185803.053216:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185803.053226:0:15368:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789185803.053230:0:15368:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff98f1c34b99c0) has no exports 00000020:00000080:1.0:1789185803.053236:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72ceb 00000020:00000080:1.0:1789185803.053241:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f1c310c000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789185803.055594:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c310a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1789185803.058427:0:15368:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789185803.058435:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789185803.058454:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1789185803.058461:0:15368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789185803.058464:0:15368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789185803.058505:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185803.058517:0:15368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789185803.058525:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72bb0 00000020:00000080:1.0:1789185803.058534:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f300ec5000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789185803.058541:0:15368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789185803.058546:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185803.058550:0:15368:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789185803.058554:0:15368:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff98f2f27a19c0) has no exports 00000020:00000080:1.0:1789185803.058560:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72ba9 00000020:00000080:1.0:1789185803.058563:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f300f01800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789185803.059464:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c310c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789185803.059486:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c3109800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789185803.059493:0:37:0:(genops.c:885:class_export_put()) final put ffff98f1c310f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789185803.059496:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c310f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1789185803.059502:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789185803.059585:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300ec5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789185803.059591:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300f01800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789185803.060425:0:15368:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789185803.060431:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789185803.060434:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789185803.060440:0:15368:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789185803.060442:0:15368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789185803.060492:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185803.060502:0:15368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789185803.060519:0:15368:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789185803.060526:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72a0c 00000020:00000080:1.0:1789185803.060533:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2faf77800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789185803.060539:0:15368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789185803.060544:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185803.060549:0:15368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789185803.060552:0:15368:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff98f300184d40) has no exports 00000020:00000080:1.0:1789185803.060557:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72a05 00000020:00000080:1.0:1789185803.060561:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2ce17b800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789185803.060731:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f300f06000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789185803.060748:0:37:0:(genops.c:885:class_export_put()) final put ffff98f300e75000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789185803.060751:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300e75000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789185803.060755:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789185803.060834:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2faf77800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789185803.060839:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2ce17b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789185803.144140:0:15368:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1789185803.144148:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789185803.144153:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789185803.144176:0:15368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789185803.144288:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185803.144302:0:15368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789185803.144368:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185803.144373:0:15368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789185803.144380:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2c35bf800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789185803.144385:0:15368:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c35bf800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789185803.144394:0:15368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789185803.144578:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a729f0 00000020:00000080:1.0:1789185803.144586:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2fa188800/lustre-MDD0001_UUID 00000020:00000080:3.0:1789185803.144726:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2ce17e800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789185803.144735:0:37:0:(genops.c:885:class_export_put()) final put ffff98f2f27a8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789185803.144737:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2f27a8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1789185803.144745:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789185803.145230:0:15368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1789185803.145236:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185803.145243:0:15368:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789185803.145247:0:15368:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff98f3003899c0) has no exports 00000020:00000080:1.0:1789185803.145268:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185803.145271:0:15368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1789185803.145276:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a729f7 00000020:00000080:1.0:1789185803.145282:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2fa18e800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789185803.145300:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2fa188800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1789185803.145359:0:37:0:(genops.c:885:class_export_put()) final put ffff98f2fa189800/lustre-MDD0001_UUID 00000020:00000080:3.0:1789185803.145362:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2fa189800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1789185803.145367:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:1.0:1789185803.145621:0:15368:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f30030e800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1789185803.145625:0:15368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f30030e800 2 00000020:01000004:1.0:1789185803.145628:0:15368:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f30030e800 from lustre-MDT0001 00000020:00000080:1.0:1789185803.145648:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185803.145651:0:15368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789185803.145654:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2fa18f800/lustre-MDT0001_UUID 00000020:00000080:1.0:1789185803.145656:0:15368:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2fa18f800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1789185803.145663:0:15368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1789185803.145698:0:15368:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1789185803.145701:0:15368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1789185803.145704:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185803.145706:0:15368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789185803.145713:0:15368:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff98f2fa188000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789185803.145727:0:15368:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff98f2f27a4d40) has exports, disconnecting them 00000020:00080000:1.0:1789185803.145732:0:15368:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff98f2fa188000), last request at 1789185538 00000020:00000080:1.0:1789185803.145735:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72a4b 00000020:00080000:1.0:1789185803.145748:0:15368:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f2fa188000): rc 0 00000020:00000080:1.0:1789185803.145751:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2fa188000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789185803.145779:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2fa18e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789185803.146807:0:15368:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789185803.146831:0:15368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789185803.146835:0:15368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789185803.146842:0:15368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789185803.147216:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2fa188000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789185803.147491:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185803.147499:0:15368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789185803.147506:0:15368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f30030e800 1 00000020:00000080:1.0:1789185803.147512:0:15368:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72987 00000020:00000080:1.0:1789185803.147520:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2d26c9000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789185803.147722:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2d26c8000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789185803.147729:0:37:0:(genops.c:885:class_export_put()) final put ffff98f2d26ca800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1789185803.147732:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2d26ca800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1789185803.147736:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:1.0:1789185803.148086:0:15368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789185803.148092:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185803.148097:0:15368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789185803.148102:0:15368:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff98f300388000) has no exports 00000020:00000080:3.0:1789185803.150649:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2d26c9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789185803.323789:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789185803.323818:0:15368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1789185803.323825:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f30030d000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789185803.323829:0:15368:0:(genops.c:844:class_export_destroy()) destroying export ffff98f30030d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789185803.323835:0:15368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789185803.324598:0:15368:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f30030f800 00000020:01000000:3.0:1789185803.324623:0:15368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789185803.324636:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789185803.324642:0:15368:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789185803.324646:0:15368:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff98f2c6fd19c0) has no exports 00000100:00100000:0.0:1789185803.324872:0:9473:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff98f2d8b2ee00:9473] 4 exiting: rc = 0 00000100:00100000:0.0:1789185803.325010:0:6514:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff98f2ce3d8600:6514] 2 exiting: rc = 0 00000100:00100000:2.0:1789185803.325127:0:6513:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff98f2ce3d9e00:6513] 1 exiting: rc = 0 00000100:00100000:3.0:1789185803.325230:0:6512:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff98f2e7aed400:6512] 0 exiting: rc = 1 00000100:00100000:1.0:1789185803.325413:0:8147:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff98f2d2e0d200:8147] 3 exiting: rc = 0 00000100:00100000:3.0:1789185803.325536:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325545:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325550:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325555:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325561:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325566:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325574:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325579:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325585:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325590:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325595:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325600:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325612:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325620:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325626:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325630:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325636:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325641:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325647:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325653:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325658:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325664:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325670:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325675:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325680:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325685:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325690:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325697:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325702:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325709:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325715:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325731:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325738:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325743:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325749:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325753:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325759:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325764:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325772:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325777:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325782:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325788:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325794:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325799:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325819:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325826:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325833:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325839:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325845:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325851:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325856:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325863:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.325869:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326174:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326183:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326188:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326194:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326199:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326205:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326212:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326218:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326242:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326249:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.326254:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185803.329951:0:6516:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98f2f29e5e00:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1789185803.330171:0:6515:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98f2f29e4800:6515] 0 exiting: rc = 1 00000100:00100000:2.0:1789185803.330286:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330296:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330303:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330311:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330317:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330322:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330329:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330334:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330339:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330345:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330350:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330356:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330362:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330367:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330373:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330378:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330383:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330388:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330393:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330398:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330402:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330407:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330413:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330418:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330424:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330430:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330436:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330442:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330464:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330469:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330474:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330479:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330484:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330489:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330494:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330500:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330505:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330510:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330515:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330520:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330524:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330528:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330534:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330539:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330544:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330549:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330554:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330559:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330564:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330570:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330575:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330580:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330585:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330589:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330595:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330600:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330605:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330610:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330615:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330621:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330625:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330630:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330634:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.330646:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.333527:0:7759:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff98f300d69c00:7759] 2 exiting: rc = 0 00000100:00100000:3.0:1789185803.334427:0:6518:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff98f2e0315800:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1789185803.334830:0:6517:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff98f2e59c3c00:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1789185803.335011:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335021:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335028:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335034:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335040:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335061:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335081:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335088:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335094:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335100:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335106:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335113:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335119:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335125:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335131:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335138:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335144:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335164:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335171:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335177:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335184:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335189:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335195:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335202:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335208:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335214:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335220:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335225:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335231:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335252:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335259:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335264:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335271:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335277:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335290:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335295:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335302:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335307:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335313:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335318:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335324:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335344:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335350:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335357:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335363:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335369:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335374:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335380:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335386:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335396:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335402:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335408:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335413:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335432:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335439:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335444:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335449:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335455:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335461:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335466:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335475:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335480:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335485:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.335498:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185803.349543:0:6520:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98f2e0314200:6520] 1 exiting: rc = 0 00000100:00100000:0.0:1789185803.349828:0:6519:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98f2e0314c00:6519] 0 exiting: rc = 1 00000100:00100000:3.0:1789185803.350425:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350432:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350437:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350442:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350447:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350452:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350458:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350462:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350467:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350471:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350476:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350480:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350484:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350489:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350493:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350498:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350502:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350506:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350511:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350515:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350520:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350524:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350529:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350533:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350538:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350542:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350548:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350553:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350557:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350562:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350566:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350570:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350574:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350578:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350583:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350600:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350605:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350610:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350614:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350619:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350623:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350628:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350632:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350636:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350641:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350646:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350650:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350654:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350659:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350664:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350668:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350673:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350677:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350682:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350687:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350691:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350696:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350701:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350705:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350710:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350715:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350720:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350724:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.350729:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.352625:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98f2e6591a00:6522] 1 exiting: rc = 0 00000100:00100000:0.0:1789185803.352823:0:6521:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98f2e6590400:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1789185803.353252:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353259:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353264:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353269:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353274:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353290:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353296:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353302:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353307:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353313:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353318:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353323:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353330:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353335:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353340:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353345:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353350:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353355:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353360:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353366:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353372:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353378:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353383:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353388:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353394:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353399:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353404:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353410:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353415:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353419:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353425:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353430:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353435:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353440:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353446:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353451:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353456:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353462:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353468:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353473:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353486:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353490:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353496:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353502:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353507:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353513:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353518:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353524:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353529:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353534:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353540:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353546:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353551:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353558:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353563:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353570:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353575:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353580:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353585:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353591:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353596:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353601:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353607:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.353613:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.354467:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff98f2e6591c00:6523] 0 exiting: rc = 1 00000100:00100000:0.0:1789185803.354572:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff98f2e6590c00:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1789185803.354690:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354697:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354702:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354708:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354713:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354719:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354725:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354731:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354736:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354742:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354747:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354764:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354770:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354775:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354780:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354786:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354792:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354797:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354814:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354821:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354826:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354832:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354838:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354843:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354848:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354853:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354859:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354864:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.354870:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358623:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358648:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358654:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358658:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358664:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358669:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358674:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358679:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358684:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358692:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358697:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358702:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358708:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358714:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358719:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358724:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358730:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358753:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358758:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358764:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358769:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358773:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358778:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358783:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358789:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358794:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358799:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358820:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358825:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358830:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358835:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358839:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358844:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358849:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789185803.358854:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.369875:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff98f2ce1ff800:6527] 2 exiting: rc = 0 00000100:00100000:0.0:1789185803.370212:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff98f2f29e5200:6525] 0 exiting: rc = 1 00000100:00100000:1.0:1789185803.370461:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff98f2ce1fe600:6526] 1 exiting: rc = 0 00000100:00100000:3.0:1789185803.370588:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370597:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370602:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370620:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370626:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370632:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370637:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370643:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370648:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370653:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370659:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370664:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370670:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370675:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370731:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370737:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370743:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370748:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370753:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370759:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370765:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370770:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370776:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370781:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370802:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370820:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370826:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370832:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370837:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370842:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370848:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370853:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370858:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370863:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370868:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370873:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370878:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370884:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370896:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.370901:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371089:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371096:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371101:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371107:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371112:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371118:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371124:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371129:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371149:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371157:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371163:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371168:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371173:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371178:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371184:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371189:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371195:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371201:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371207:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371213:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371218:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371223:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371228:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185803.371233:0:15368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789185803.376329:0:15368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789185803.376345:0:15368:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789185803.376351:0:15368:0:(genops.c:885:class_export_put()) final put ffff98f2c6ff7800/MDS_uuid 00000020:00000080:3.0:1789185803.376356:0:15368:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c6ff7800/MDS_uuid for MDS 00000020:01000000:3.0:1789185803.376365:0:15368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789185803.376515:0:15368:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789185803.562446:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185804.582128:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789185804.711268:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185804.711279:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185804.711283:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185804.711286:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789185804.711290:0:38:0:(import.c:65:import_set_state_nolock()) ffff98f1c207d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185804.711299:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 438 00000100:00080000:0.0:1789185804.711305:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789185804.711320:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f1c207d800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185804.711367:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758c700 x1876096898479104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185804.711483:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898479232:0@lo:400:kworker.0 00000400:00000100:2.0:1789185804.711544:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898479232 offset 0 length 224: 4 00000100:00100000:1.0:1789185804.711648:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898479104:0@lo:38:kworker.0 00000400:00000100:1.0:1789185804.711672:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898479104 offset 0 length 520: 4 00000100:00080000:0.0:1789185804.711799:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185804.711820:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789185804.711823:0:38:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185804.711827:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 438 00000100:00080000:0.0:1789185804.711830:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789185804.711836:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f1c316b800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185804.711851:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758ea00 x1876096898479360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185804.711903:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898479488:0@lo:400:kworker.0 00000400:00000100:0.0:1789185804.711949:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898479488 offset 0 length 224: 4 00000100:00100000:1.0:1789185804.712197:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898479360:0@lo:38:kworker.0 00000400:00000100:1.0:1789185804.712219:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898479360 offset 0 length 520: 4 00010000:00010000:2.0:1789185805.606789:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185806.630386:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185807.661537:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789185807.718971:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185807.718986:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185807.718989:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185807.718994:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185807.719070:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185807.719075:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789185807.719129:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898479744:0@lo:400:kworker.0 00000400:00000100:0.0:1789185807.719202:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898479744 offset 0 length 224: 4 00000100:00100000:2.0:1789185807.719237:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185807.719372:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898479616:0@lo:400:kworker.0 00000400:00000100:2.0:1789185807.719402:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898479616 offset 0 length 224: 4 00000020:01000004:0.0:1789185807.751193:0:15568:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789185807.767105:0:15568:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789185807.767316:0:15568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185807.767335:0:15568:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185807.767368:0:15568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185807.767376:0:15568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185807.767442:0:15568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789185807.767450:0:15568:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789185807.767490:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789185807.767507:0:15568:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758c700 x1876096898479104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789185824 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185807.767529:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789185807.767548:0:15568:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789185807.767558:0:15568:0:(import.c:65:import_set_state_nolock()) ffff98f1c207d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789185807.767565:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789185807.767569:0:15568:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758c700 x1876096898479104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789185824 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185807.767577:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789185807.767581:0:15568:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1789185807.769007:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898479104:0@lo:38:kworker.0 00010000:00010000:2.0:1789185807.770348:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185807.770365:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185807.770380:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf9c00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:2.0:1789185807.770403:0:9518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185807.770417:0:9518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185807.770426:0:9518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185807.770433:0:9518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789185807.770436:0:9518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789185807.770440:0:9518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789185807.770463:0:9518:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f2c6ff6000 00010000:00010000:2.0:1789185807.770469:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185807.770477:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf9c00/0xda5c730d5a72dd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a72dd9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185807.770493:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185807.770495:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185807.770497:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789185807.774453:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789185807.774479:0:15568:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758c000 x1876096898479232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185820 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185807.774510:0:15568:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758f480 x1876096898479616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185823 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185807.774527:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789185807.774556:0:15568:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789185807.774593:0:15568:0:(import.c:65:import_set_state_nolock()) ffff98f1c2079000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789185807.774613:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898479232:0@lo:400:kworker.0 00000100:00100000:0.0:1789185807.774632:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876096898479872:0@lo:39:umount.0 00000400:00000100:0.0:1789185807.774700:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898479872 offset 0 length 224: 4 00000100:00100000:3.0:1789185807.776987:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898479616:0@lo:400:kworker.0 00010000:00010000:2.0:1789185808.679508:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789185808.809529:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789185808.809549:0:8423:0:(genops.c:885:class_export_put()) final put ffff98f301c21000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789185808.810762:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f301c21000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789185808.810834:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f301c24000 for lustre-OST0000 00000001:00100000:2.0:1789185808.811341:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789185808.811348:0:9508:0:(genops.c:885:class_export_put()) final put ffff98f1c316c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789185808.815055:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c316c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789185808.815145:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c316b000 for lustre-OST0001 00010000:00010000:2.0:1789185809.702232:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789185809.766764:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185809.766778:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185809.766782:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789185809.766785:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789185809.767013:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898480000:0@lo:400:kworker.0 00000400:00000100:3.0:1789185809.767074:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898480000 offset 0 length 224: 4 00010000:00010000:2.0:1789185810.726238:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185811.751718:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185812.774274:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185812.905506:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185802/real 1789185802] req@ffff98f1c34b3480 x1876096898478976/t0(0) o250->MGC192.168.204.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789185812 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185812.905546:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f1c34b3480 x1876096898478976/t0(0) o250->MGC192.168.204.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789185812 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789185812.905571:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c6ff6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789185812.905605:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789185812.905610:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9010c27d-11d2-44c0-a2e4-e8975764c875:3634:1876096898478976:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1789185812.909976:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789185812.909987:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789185812.909992:0:38:0:(import.c:65:import_set_state_nolock()) ffff98f2c6ff6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185812.910001:0:38:0:(import.c:545:import_select_connection()) MGC192.168.204.148@tcp: connect to NID 0@lo last attempt 442 00000100:00080000:3.0:1789185812.910008:0:38:0:(import.c:630:import_select_connection()) MGC192.168.204.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789185812.910025:0:38:0:(import.c:666:import_select_connection()) MGC192.168.204.148@tcp: import ffff98f2c6ff6000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185812.910078:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2c87bb480 x1876096898480128/t0(0) o250->MGC192.168.204.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185812.910122:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789185812.910127:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789185812.910669:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185812.910697:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898480256:0@lo:400:kworker.0 00000400:00000100:0.0:1789185812.910784:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898480256 offset 0 length 224: 4 00000100:00100000:1.0:1789185812.911939:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9010c27d-11d2-44c0-a2e4-e8975764c875:3634:1876096898480128:0@lo:250:kworker.0 00000400:00000100:1.0:1789185812.912005:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876096898480128 offset 0 length 520: 4 00010000:00010000:2.0:1789185813.801747:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185814.822183:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185815.846265:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185816.870347:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185817.062304:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185807/real 1789185807] req@ffff98f2f758c700 x1876096898479872/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789185817 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185817.062350:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f2f758c700 x1876096898479872/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789185817 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789185817.062370:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c2079000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789185817.062392:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876096898479872:0@lo:39:umount.0 00000100:00080000:0.0:1789185817.062488:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789185817.062493:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789185817.062499:0:15568:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789185817.063795:0:15568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185817.063813:0:15568:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185817.063820:0:15568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185817.063828:0:15568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185817.063875:0:15568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185817.063882:0:15568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185817.063889:0:15568:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185817.063896:0:15568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185817.063902:0:15568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185817.064253:0:15568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789185817.064259:0:15568:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789185817.064284:0:15568:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789185817.064289:0:15568:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789185817.064294:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185817.064298:0:15568:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789185817.064303:0:15568:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff98f2f75e4d40) has no exports 00000020:00080000:0.0:1789185817.064326:0:15568:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff98f2f75e4d40) has no exports 00010000:00010000:3.0:1789185817.069014:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185817.069029:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185817.069042:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185817.069047:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185817.069057:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185817.069081:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185817.069087:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789185817.069090:0:9517:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789185817.069093:0:9517:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789185817.069112:0:9517:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f2c6ff6000 00010000:00010000:3.0:1789185817.069116:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185817.069122:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a72de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a72de7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185817.069137:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185817.069141:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185817.069147:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031a00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185817.069150:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185817.069156:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185817.069162:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185817.069166:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789185817.069168:0:9517:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789185817.069174:0:9517:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789185817.069179:0:9517:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f2c6ff6000 00010000:00010000:3.0:1789185817.069182:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185817.069187:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73056 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a7305d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185817.069195:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185817.069197:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185817.069199:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185817.069599:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789185817.075236:0:15568:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f300cce480 - data ffff98f2dcf56ca8/ffff98f2fa0b5400 00000020:01000000:0.0:1789185817.075362:0:15568:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f1c1bcf540 - data ffff98f2dce76a20/ffff98f1c19cf400 00100000:10000000:0.0:1789185817.085811:0:15568:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789185817.106166:0:15568:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72b24 00000020:00000080:1.0:1789185817.106181:0:15568:0:(genops.c:885:class_export_put()) final put ffff98f301c26800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789185817.106242:0:15568:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2d26ca000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789185817.106247:0:15568:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2d26ca000 2 00000020:01000004:1.0:1789185817.106250:0:15568:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f2d26ca000 from lustre-OST0000 00000020:00000080:1.0:1789185817.106277:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185817.106287:0:15568:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789185817.106290:0:15568:0:(genops.c:885:class_export_put()) final put ffff98f301c27800/lustre-OST0000_UUID 00000020:00000080:1.0:1789185817.106294:0:15568:0:(genops.c:844:class_export_destroy()) destroying export ffff98f301c27800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789185817.106314:0:15568:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789185817.106374:0:15568:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789185817.106378:0:15568:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789185817.106382:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185817.106386:0:15568:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789185817.106393:0:15568:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98f1c2078000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789185817.106398:0:15568:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff98f1c20719c0) has exports, disconnecting them 00000020:00080000:1.0:1789185817.106403:0:15568:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98f1c2078000), last request at 1789185561 00000020:00000080:1.0:1789185817.106406:0:15568:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72b4e 00000020:00080000:1.0:1789185817.106417:0:15568:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f1c2078000): rc 0 00000020:00000080:1.0:1789185817.106422:0:15568:0:(genops.c:885:class_export_put()) final put ffff98f1c2078000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789185817.109405:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f301c26800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789185817.114134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c2078000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789185817.114948:0:15568:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789185817.114955:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789185817.114969:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789185817.114975:0:15568:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789185817.115147:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185817.115155:0:15568:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789185817.115161:0:15568:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789185817.115165:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185817.115169:0:15568:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789185817.115175:0:15568:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff98f1c2079800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789185817.115181:0:15568:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff98f1c2070000) has exports, disconnecting them 00000020:00080000:0.0:1789185817.115186:0:15568:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff98f1c2079800), last request at 1789185561 00000020:00000080:0.0:1789185817.115190:0:15568:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72b63 00000020:00080000:0.0:1789185817.115204:0:15568:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f1c2079800): rc 0 00000020:00000080:0.0:1789185817.115209:0:15568:0:(genops.c:885:class_export_put()) final put ffff98f1c2079800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789185817.115744:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c207d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789185817.115754:0:37:0:(genops.c:885:class_export_put()) final put ffff98f301048800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789185817.115757:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f301048800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789185817.115769:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789185817.115835:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c2079800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789185817.121766:0:15568:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789185817.121775:0:15568:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789185817.121779:0:15568:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789185817.121786:0:15568:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789185817.122041:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185817.122051:0:15568:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789185817.122059:0:15568:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2d26ca000 1 00000020:00000080:0.0:1789185817.122068:0:15568:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72aec 00000020:00000080:0.0:1789185817.122079:0:15568:0:(genops.c:885:class_export_put()) final put ffff98f300f57800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789185817.122085:0:15568:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789185817.122092:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185817.122096:0:15568:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789185817.122099:0:15568:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff98f2c6fd3380) has no exports 00000020:00000080:0.0:1789185817.147086:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c2079000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789185817.147101:0:37:0:(genops.c:885:class_export_put()) final put ffff98f1c207d000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789185817.147106:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c207d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789185817.147120:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789185817.147201:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300f57800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789185817.376465:0:15568:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185817.376481:0:15568:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789185817.376487:0:15568:0:(genops.c:885:class_export_put()) final put ffff98f2c2af4000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789185817.376493:0:15568:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c2af4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789185817.376502:0:15568:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789185817.376695:0:15568:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f2d26cb800 00000020:02000400:0.0:1789185817.376769:0:15568:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789185817.894212:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789185818.023329:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789185818.023338:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789185818.023341:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789185818.023344:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789185818.023454:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898480384:0@lo:400:kworker.0 00000400:00000100:0.0:1789185818.023547:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898480384 offset 0 length 224: 4 00010000:00010000:2.0:1789185818.920073:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185819.942244:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1789185820.902127:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185804/real 1789185804] req@ffff98f2f758f800 x1876096898479488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789185820 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185820.966701:0:3637:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98f2f758f800 x1876096898479488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789185820 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789185820.966721:0:3637:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fc000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789185820.966726:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00010000:2.0:1789185820.969105:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789185821.006058:0:3637:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1789185821.006742:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789185821.006752:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789185821.006755:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789185821.006758:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789185821.006761:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789185821.006764:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789185821.006768:0:38:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789185821.006776:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 222 00000100:00080000:2.0:1789185821.006792:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98f1c30fc000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:2.0:1789185821.006833:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b0000 x1876096898480512/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185821.006902:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898479488:0@lo:400:kworker.0 00000100:00100000:3.0:1789185821.007097:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876096898480512:0@lo:38:kworker.0 00000400:00000100:3.0:1789185821.007189:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876096898480512 offset 0 length 520: 4 00010000:00010000:2.0:1789185821.990565:0:9518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789185822.314167:0:15770:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789185822.326765:0:15770:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789185822.326856:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185822.326871:0:15770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185822.326879:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185822.326886:0:15770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185822.326935:0:15770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789185822.326941:0:15770:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789185822.326966:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789185822.326977:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758ea00 x1876096898479360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789185824 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185822.327000:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789185822.327156:0:15770:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789185822.327164:0:15770:0:(import.c:65:import_set_state_nolock()) ffff98f1c316b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789185822.327170:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789185822.327174:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758ea00 x1876096898479360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789185824 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185822.327183:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789185822.327186:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1789185822.327297:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898479360:0@lo:38:kworker.0 00010000:00010000:2.0:1789185822.327799:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185822.327808:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.327817:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8a00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:2.0:1789185822.327821:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.327843:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185822.327849:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185822.327854:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789185822.327856:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789185822.327859:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789185822.327872:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f2c6ff6000 00010000:00010000:2.0:1789185822.327877:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.327883:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8a00/0xda5c730d5a72db6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a72dbd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.327895:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185822.327897:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185822.327898:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789185822.331198:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789185822.331215:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758dc00 x1876096898479744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185823 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185822.331233:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758c380 x1876096898480000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185825 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185822.331261:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2c87b8380 x1876096898480256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185828 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185822.331278:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f1c34b3480 x1876096898480384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185834 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185822.331285:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f1c19b0000 x1876096898480512/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789185831 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185822.331297:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789185822.331336:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898480384:0@lo:400:kworker.0 00000100:00100000:0.0:1789185822.331344:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898480256:0@lo:400:kworker.0 00000100:00080000:2.0:1789185822.331480:0:15770:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789185822.331484:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898479744:0@lo:400:kworker.0 00000100:00080000:2.0:1789185822.331488:0:15770:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789185822.331493:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789185822.331497:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2f758c380 x1876096898480000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185825 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185822.331603:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898480000:0@lo:400:kworker.0 00000100:00100000:2.0:1789185822.331737:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2c87b8380 x1876096898480256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185828 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185822.331745:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f1c19b0000 x1876096898480512/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789185831 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185822.331772:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789185822.337532:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876096898480512:0@lo:38:kworker.0 00000100:00100000:2.0:1789185822.337532:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789185822.339044:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185822.339062:0:15770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185822.339070:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185822.339078:0:15770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185822.339102:0:15770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185822.339110:0:15770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185822.339118:0:15770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185822.339126:0:15770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.339128:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185822.339137:0:15770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.339139:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.339154:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8600 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:2.0:1789185822.339159:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.339169:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185822.339177:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185822.339183:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789185822.339186:0:9517:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789185822.339199:0:9517:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f2c6ff6000 00010000:00010000:2.0:1789185822.339209:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.339217:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8600/0xda5c730d5a72dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a72dcb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.339233:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185822.339236:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.339322:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031600 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:2.0:1789185822.339339:0:9517:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.339345:0:9517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185822.339351:0:9517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185822.339355:0:9517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789185822.339357:0:9517:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789185822.339361:0:9517:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f2c6ff6000 00010000:00010000:2.0:1789185822.339364:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.339372:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185822.339373:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185822.339396:0:15770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789185822.339415:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031600/0xda5c730d5a73048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a7304f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185822.339431:0:15770:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789185822.339436:0:15770:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789185822.339439:0:15770:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789185822.339477:0:15770:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789185822.339481:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789185822.339491:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789185822.339498:0:15770:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789185822.339502:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff98f2f75e19c0) has no exports 00000020:00080000:3.0:1789185822.339526:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff98f2f75e19c0) has no exports 00000020:01000000:3.0:1789185822.342212:0:15770:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f300ccef00 - data ffff98f2dcda66c0/ffff98f2fa0b4c00 00000020:01000000:3.0:1789185822.344210:0:15770:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98f1c31a56c0 - data ffff98f1c1c06e58/ffff98f1c32a6000 00010000:00010000:2.0:1789185822.345292:0:9517:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185822.345542:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789185822.367078:0:15770:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789185822.377618:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72c4a 00000020:00000080:2.0:1789185822.377630:0:15770:0:(genops.c:885:class_export_put()) final put ffff98f2ff923800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789185822.377655:0:15770:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2ff976000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789185822.377659:0:15770:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2ff976000 2 00000020:01000004:2.0:1789185822.377663:0:15770:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f2ff976000 from lustre-OST0001 00000020:00000080:2.0:1789185822.377686:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789185822.377697:0:15770:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789185822.377700:0:15770:0:(genops.c:885:class_export_put()) final put ffff98f2ff925800/lustre-OST0001_UUID 00000020:00000080:2.0:1789185822.377703:0:15770:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2ff925800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789185822.377710:0:15770:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789185822.377856:0:15770:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9010c27d-11d2-44c0-a2e4-e8975764c875->MGS 00010000:00010000:2.0:1789185822.377874:0:15770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3c00/0xda5c730d5a729a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a729aa expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185822.377933:0:15770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3c00/0xda5c730d5a729a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a729aa expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185822.377940:0:15770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789185822.377943:0:15770:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789185822.377947:0:15770:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789185822.377967:0:15770:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f2c6ff6000 00010000:00010000:2.0:1789185822.377971:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3c00/0xda5c730d5a729a3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a729aa expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185822.377988:0:15770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xda5c730d5a72e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789185822.377996:0:15770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xda5c730d5a72e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185822.378000:0:15770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789185822.378003:0:15770:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789185822.378005:0:15770:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789185822.378014:0:15770:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f2c6ff6000 00010000:00010000:2.0:1789185822.378017:0:15770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166c400/0xda5c730d5a72e26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xda5c730d5a72e2d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789185822.378035:0:15770:0:(import.c:65:import_set_state_nolock()) ffff98f2c6ff6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789185822.378040:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789185822.378042:0:15770:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789185822.378044:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789185822.378048:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789185822.378059:0:15770:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f2c87bb480 x1876096898480128/t0(0) o250->MGC192.168.204.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789185827 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789185822.378090:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789185822.378092:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:3.0:1789185822.378261:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2ff923800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789185822.378488:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9010c27d-11d2-44c0-a2e4-e8975764c875:3634:1876096898480128:0@lo:250:kworker.0 10000000:01000000:2.0:1789185822.378578:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789185822.378586:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a728a0 00000020:00000080:2.0:1789185822.378592:0:15770:0:(genops.c:885:class_export_put()) final put ffff98f2c6ff3800/9010c27d-11d2-44c0-a2e4-e8975764c875 00000020:01000000:2.0:1789185822.378608:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.148@tcp (flags='') 00000020:00000080:2.0:1789185822.378614:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789185822.378619:0:15770:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.148@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789185822.378622:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff98f2c6fd4d40) has no exports 00000020:00000080:3.0:1789185822.378670:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c6ff3800/9010c27d-11d2-44c0-a2e4-e8975764c875 for MGC192.168.204.148@tcp 10000000:01000000:0.0:1789185822.378843:0:6509:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789185822.379021:0:15770:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.148@tcp: client import never connected 00000100:00080000:2.0:1789185822.379025:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789185822.379027:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789185822.379029:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789185822.379031:0:15770:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789185822.379173:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789185822.379180:0:15770:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.148@tcp (uuid 9010c27d-11d2-44c0-a2e4-e8975764c875) 00000020:01000000:2.0:1789185822.379186:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789185822.379190:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789185822.379194:0:15770:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789185822.379198:0:15770:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98f1c316f800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789185822.379204:0:15770:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff98f1c2073380) has exports, disconnecting them 00000020:00080000:2.0:1789185822.379209:0:15770:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98f1c316f800), last request at 1789185582 00000020:00000080:2.0:1789185822.379213:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72c74 00000020:00080000:2.0:1789185822.379224:0:15770:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f1c316f800): rc 0 00000020:00000080:2.0:1789185822.379228:0:15770:0:(genops.c:885:class_export_put()) final put ffff98f1c316f800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789185822.379324:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f2c6ff6000 for MGC192.168.204.148@tcp 00000020:00000080:3.0:1789185822.379332:0:37:0:(genops.c:885:class_export_put()) final put ffff98f2c6ff5800/9010c27d-11d2-44c0-a2e4-e8975764c875 00000020:00000080:3.0:1789185822.379334:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2c6ff5800/9010c27d-11d2-44c0-a2e4-e8975764c875 for MGC192.168.204.148@tcp 00000020:01000000:3.0:1789185822.379339:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.148@tcp (9010c27d-11d2-44c0-a2e4-e8975764c875) 00000020:00000080:3.0:1789185822.381345:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c316f800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789185822.383024:0:15770:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789185822.383032:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789185822.383036:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789185822.383043:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789185822.383264:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789185822.383273:0:15770:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789185822.383281:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789185822.383286:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789185822.383301:0:15770:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789185822.383309:0:15770:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff98f1c30f9000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789185822.383316:0:15770:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff98f2f75e0000) has exports, disconnecting them 00000020:00080000:3.0:1789185822.383320:0:15770:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff98f1c30f9000), last request at 1789185582 00000020:00000080:3.0:1789185822.383324:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72c82 00000020:00080000:3.0:1789185822.383341:0:15770:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f1c30f9000): rc 0 00000020:00000080:3.0:1789185822.383345:0:15770:0:(genops.c:885:class_export_put()) final put ffff98f1c30f9000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1789185822.384508:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c316b800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789185822.384530:0:37:0:(genops.c:885:class_export_put()) final put ffff98f300e77000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789185822.384534:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300e77000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789185822.384541:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789185822.384603:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c30f9000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789185822.403989:0:15770:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789185822.404005:0:15770:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789185822.404009:0:15770:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789185822.404016:0:15770:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789185822.404051:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff98f1c30fc000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789185822.429093:0:9518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789185822.430462:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789185822.430659:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1789185822.430824:0:9517:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1789185822.431057:0:6495:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98f2d9848a00:6495] 1 exiting: rc = 0 00000100:00100000:1.0:1789185822.432271:0:6494:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98f2d9848000:6494] 0 exiting: rc = 1 00000100:00100000:0.0:1789185822.432349:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185822.433063:0:10394:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98f1c356f400:10394] 3 exiting: rc = 0 00000100:00100000:2.0:1789185822.435775:0:6497:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98f2d7183a00:6497] 1 exiting: rc = 0 00000100:00100000:2.0:1789185822.435886:0:6496:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98f2d7183e00:6496] 0 exiting: rc = 1 00000100:00100000:0.0:1789185822.443866:0:6498:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98f2c3b5dc00:6498] 2 exiting: rc = 0 00000100:00100000:0.0:1789185822.444014:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444023:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444031:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444038:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444044:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444051:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444058:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444065:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444070:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444076:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444082:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444088:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444094:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444101:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444109:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444115:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444120:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444128:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444134:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444141:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444147:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444173:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444178:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444185:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444190:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444196:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444201:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444207:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444212:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444218:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444223:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444228:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444233:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444238:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444243:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444248:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444254:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444259:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444265:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444270:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444276:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444282:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444286:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444292:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444298:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444305:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444310:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444315:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444320:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444326:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444331:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444336:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444341:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444346:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444351:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444356:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444368:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444374:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444380:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444385:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444390:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444396:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444401:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.444406:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789185822.449252:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789185822.449265:0:15770:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789185822.449283:0:15770:0:(genops.c:885:class_export_put()) final put ffff98f1c30fd800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789185822.449288:0:15770:0:(genops.c:844:class_export_destroy()) destroying export ffff98f1c30fd800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789185822.449294:0:15770:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789185822.449355:0:15770:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2ff976000 1 00000020:00000080:0.0:1789185822.449360:0:15770:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xda5c730d5a72c19 00000020:00000080:0.0:1789185822.449366:0:15770:0:(genops.c:885:class_export_put()) final put ffff98f2ff924000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789185822.449377:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789185822.449380:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789185822.449384:0:15770:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789185822.449388:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff98f2f27a0000) has no exports 00000020:00000080:2.0:1789185822.449838:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2ff924000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789185822.491744:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185822.491758:0:15770:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789185822.491765:0:15770:0:(genops.c:885:class_export_put()) final put ffff98f2ff974000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789185822.491770:0:15770:0:(genops.c:844:class_export_destroy()) destroying export ffff98f2ff974000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789185822.491781:0:15770:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789185822.492671:0:15770:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f2ff970000 00000020:01000000:1.0:1789185822.492696:0:15770:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789185822.492701:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789185822.492706:0:15770:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789185822.492710:0:15770:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff98f2f75e3380) has no exports 00000020:00000080:1.0:1789185822.492749:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789185822.492755:0:15770:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789185822.492759:0:15770:0:(genops.c:885:class_export_put()) final put ffff98f300f55000/OSS_uuid 00000020:00000080:1.0:1789185822.492762:0:15770:0:(genops.c:844:class_export_destroy()) destroying export ffff98f300f55000/OSS_uuid for OSS 00000020:01000000:1.0:1789185822.492766:0:15770:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789185822.493228:0:9819:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff98f1c22ed800:9819] 3 exiting: rc = 0 00000100:00100000:0.0:1789185822.493346:0:14734:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff98f2d284e000:14734] 4 exiting: rc = 0 00000100:00080000:2.0:1789185822.493567:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789185822.493673:0:8430:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff98f2f29e6c00:8430] 2 exiting: rc = 0 00000100:00100000:2.0:1789185822.493703:0:8427:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff98f2e7aed800:8427] 0 exiting: rc = 1 00000100:00100000:2.0:1789185822.493814:0:8429:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff98f2fa150600:8429] 1 exiting: rc = 0 00000100:00100000:1.0:1789185822.493867:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.493875:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.493882:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.493888:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.493894:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.493900:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494039:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494047:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494052:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494058:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494063:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494068:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494073:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494078:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494082:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494087:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494092:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494096:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494102:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494107:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494112:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494117:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494122:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494127:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494132:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494137:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494142:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494147:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494152:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494157:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494171:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494176:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494181:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494187:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494193:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494198:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494203:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494209:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494213:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494219:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494224:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494229:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494235:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494241:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494247:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494253:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494259:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494264:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494269:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494275:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494280:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494286:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494293:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494298:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494305:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494310:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494316:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494321:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494326:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494331:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494336:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494341:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494346:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.494352:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789185822.495250:0:8431:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98f2f2728e00:8431] 0 exiting: rc = 1 00000100:00100000:0.0:1789185822.495332:0:8993:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff98f1c19a5800:8993] 2 exiting: rc = 0 00000100:00100000:2.0:1789185822.495393:0:8432:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98f2d1737200:8432] 1 exiting: rc = 0 00000100:00100000:1.0:1789185822.495470:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495489:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495495:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495500:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495506:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495512:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495517:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495523:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495529:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495595:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495601:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495606:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495611:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495617:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495622:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495627:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495631:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495635:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495640:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495645:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495650:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495655:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495660:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495665:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495671:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495676:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495681:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495686:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495691:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495696:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495701:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495707:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495713:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495719:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495725:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495730:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495747:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495752:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495757:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495762:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495767:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495773:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495778:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495783:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495788:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495795:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495801:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495806:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495812:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495818:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495825:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495830:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495835:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495840:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495845:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495850:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495855:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495860:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495864:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495869:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495875:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495880:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495886:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.495891:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185822.497270:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98f2fae28200:8435] 2 exiting: rc = 0 00000100:00100000:0.0:1789185822.497623:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98f2fae28a00:8434] 1 exiting: rc = 0 00000100:00100000:2.0:1789185822.497896:0:8433:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98f2fae29800:8433] 0 exiting: rc = 1 00000100:00100000:1.0:1789185822.498146:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498156:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498162:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498168:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498175:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498181:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498186:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498206:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498212:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498218:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498224:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498229:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498235:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498241:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498246:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498252:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498258:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498265:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498270:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498276:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498281:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498287:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498292:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498298:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498304:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498324:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498330:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498336:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498341:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498346:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498352:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498357:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498363:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498368:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498373:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498378:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498382:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498387:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498392:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498397:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498403:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498408:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498421:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498427:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498432:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498438:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498455:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498460:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498466:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498484:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498491:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498497:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498502:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498508:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498513:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498518:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498525:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498531:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498547:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498553:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498559:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498564:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498570:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.498575:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789185822.502894:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98f300c60800:8437] 1 exiting: rc = 0 00000100:00100000:2.0:1789185822.502894:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98f30025b000:8436] 0 exiting: rc = 1 00000100:00100000:1.0:1789185822.503111:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503120:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503125:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503130:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503135:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503140:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503145:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503152:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503157:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503163:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503168:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503173:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503178:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503197:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503204:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503209:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503214:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503219:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503225:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503230:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503236:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503241:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503246:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503251:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503256:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503262:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503267:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503271:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503276:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503282:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503288:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503293:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503298:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503303:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503308:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503314:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503318:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503322:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503327:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503332:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503336:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503341:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503346:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503351:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503356:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503361:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503366:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503371:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503385:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503390:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503394:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503400:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503404:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503409:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503415:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503420:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503426:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503431:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503436:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503458:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503469:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503475:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503480:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.503487:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.504823:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98f2f754fe00:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1789185822.505045:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98f2f754f400:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1789185822.505120:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505129:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505145:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505153:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505160:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505167:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505173:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505198:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505205:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505211:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505218:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505225:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505231:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505238:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505244:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505251:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505257:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505273:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505280:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505299:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505307:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505313:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505319:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505325:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505331:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505338:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505345:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505351:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505358:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505364:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505370:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505391:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505399:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505406:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505413:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505421:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505429:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505436:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505455:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505462:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505469:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505475:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505481:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505501:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505508:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505514:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505520:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505530:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505546:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505552:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505560:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505569:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505582:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505587:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505592:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505615:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505623:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505629:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505635:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505642:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505647:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505653:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505659:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789185822.505672:0:15770:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789185822.512671:0:15770:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789185844.046686:0:16534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789185856.668242:0:17134:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789185856.668249:0:17134:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789185856.668250:0:17134:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789185856.668363:0:17134:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98f1c41b6000 00000020:01000004:3.0:1789185856.668383:0:17134:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789185856.668391:0:17134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789185856.668406:0:17134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98f1c20719c0) 00000020:00000080:3.0:1789185856.668423:0:17134:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789185856.823055:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789185856.826525:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789185856.832766:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789185856.835026:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789185856.835638:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789185856.835869:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1789185856.836129:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1789185856.836553:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789185856.837385:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789185856.841123:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1789185856.841520:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789185856.841734:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789185856.852659:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789185856.853081:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789185856.853288:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789185856.864657:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.865098:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.865626:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.868378:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.874391:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.876049:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.878715:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.880475:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.886088:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.886570:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.886876:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.888657:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.891738:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.892396:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.892671:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.892959:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.893208:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1789185856.896628:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789185856.897120:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789185856.897377:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789185856.897626:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789185856.897894:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789185856.898244:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789185856.898489:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.900194:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.900777:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.901083:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.901345:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.901711:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789185856.904065:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789185856.906114:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789185856.911070:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789185856.913890:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789185856.915172:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1789185856.915879:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789185856.918133:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789185856.918435:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789185856.918686:0:17134:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1789185856.919261:0:17134:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789185856.919477:0:17134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789185856.919484:0:17134:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789185856.919495:0:17134:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a73e4f 00000020:01000004:3.0:1789185856.919501:0:17134:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789185856.919505:0:17134:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789185856.919511:0:17134:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f1c41b6000 from MGS 00000020:01000004:3.0:1789185856.919515:0:17134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789185856.919525:0:17134:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98f1c2074d40) 00000020:00000080:3.0:1789185856.919534:0:17134:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789185856.919593:0:17134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f1c41b6000 from MGS, refs=2 00080000:01000000:3.0:1789185856.919598:0:17134:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789185856.919605:0:17134:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a73e5d 00000100:00100000:3.0:1789185856.919702:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789185856.919856:0:17134:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789185856.919862:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789185856.921313:0:17134:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789185856.921324:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789185856.922152:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789185856.922342:0:17134:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789185856.922348:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789185856.922876:0:17134:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789185856.922883:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789185856.923292:0:17134:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789185856.923300:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789185856.924165:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185856.924170:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185856.924171:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185856.924553:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185856.924556:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185856.924558:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185856.925113:0:17134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789185856.927465:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789185856.933177:0:17134:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789185856.936176:0:17146:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789185856.936272:0:17134:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789185856.936356:0:17134:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789185856.939095:0:17134:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789185856.939447:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789185856.939627:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789185856.939633:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789185856.955272:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789185856.955288:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789185856.973814:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789185856.973827:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789185856.975579:0:17134:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789185856.975603:0:17134:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.148@tcp' 00000020:01000004:3.0:1789185856.975605:0:17134:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789185856.975633:0:17134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.148@tcp (typ=mgc) 00000020:00000080:3.0:1789185856.975646:0:17134:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.148@tcp (ffff98f1c2073380) 00000020:00000080:3.0:1789185856.975660:0:17134:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789185856.975741:0:17134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f2e79cd000@MGC192.168.204.148@tcp: add connection 192.168.204.148@tcp at head 00010000:00010000:3.0:1789185856.975937:0:17134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.148@tcp-0 is initialized 00000040:01000000:3.0:1789185856.975943:0:17134:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789185856.978978:0:17151:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789185856.992478:0:17153:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789185856.992842:0:17134:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.148@tcp (uuid 8b5e51b6-f73d-464f-892e-c60a26cf0ba7) 00000020:00000080:1.0:1789185856.992869:0:17134:0:(genops.c:1384:class_connect()) connect: client 8b5e51b6-f73d-464f-892e-c60a26cf0ba7, cookie 0xda5c730d5a73e6b 00000100:00080000:1.0:1789185856.992881:0:17134:0:(import.c:545:import_select_connection()) MGC192.168.204.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185856.992895:0:17134:0:(import.c:666:import_select_connection()) MGC192.168.204.148@tcp: import ffff98f2e79cd000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185856.992968:0:17134:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b0000 x1876096898480640/t0(0) o250->MGC192.168.204.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789185856.992991:0:17134:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8b5e51b6-f73d-464f-892e-c60a26cf0ba7->MGS 00000020:01000004:1.0:1789185856.993015:0:17134:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789185856.993021:0:17134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789185856.993036:0:17134:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98f2f75e3380) 00000020:00000080:1.0:1789185856.993049:0:17134:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789185856.996064:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3634:1876096898480640:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789185856.996167:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185856.996416:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898480640 00000100:00100000:2.0:1789185856.996426:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898480640 00000100:00100000:2.0:1789185856.996558:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185856.996566:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1876096898480640:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789185856.996595:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8b5e51b6-f73d-464f-892e-c60a26cf0ba7@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:2.0:1789185856.996622:0:17147:0:(genops.c:1384:class_connect()) connect: client 8b5e51b6-f73d-464f-892e-c60a26cf0ba7, cookie 0xda5c730d5a73e79 00000100:00080000:2.0:1789185856.997151:0:17147:0:(import.c:65:import_set_state_nolock()) ffff98f2c6ff0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185856.997236:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+5:3634:x1876096898480640:12345-0@lo:250:mount.lustre.0 Request processed in 669us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185856.997245:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789185856.997934:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789185856.997946:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.148@tcp: connect to target with instance 0 00000100:00080000:2.0:1789185856.997954:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789185856.997959:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789185856.997963:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2e79cd000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789185856.997965:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789185856.999637:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789185856.999652:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3634:1876096898480640:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789185857.018487:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789185857.018712:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789185857.018717:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789185857.024339:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789185857.024357:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789185857.030875:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789185857.030889:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789185857.032352:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185857.032903:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789185857.032947:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789185857.033663:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789185857.033672:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789185857.079748:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185857.080450:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789185857.080533:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789185857.082191:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789185857.082204:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789185857.082824:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185857.083039:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789185857.083045:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789185857.083640:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789185857.083646:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789185857.084302:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185857.084453:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789185857.084459:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789185857.085253:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789185857.085260:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789185857.086147:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185857.086327:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789185857.086333:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789185857.087283:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789185857.087292:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789185857.116579:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185857.116874:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789185857.116881:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789185857.119086:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789185857.119100:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789185857.120450:0:17134:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789185857.120558:0:17134:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789185857.122086:0:17134:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789185857.122119:0:17134:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789185857.122127:0:17134:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789185857.122240:0:17134:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789185857.122275:0:17134:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.148@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789185857.122280:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789185857.122281:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789185857.122283:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185857.122284:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185857.122290:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185857.122292:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185857.122293:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789185857.122294:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789185857.122369:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185857.122372:0:17134:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789185857.122374:0:17134:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789185857.122446:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789185857.122448:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789185857.122449:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185857.122450:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185857.122451:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185857.122523:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185857.122525:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789185857.122526:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789185857.122527:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185857.122527:0:17134:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789185857.122569:0:17134:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789185857.122590:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898480768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789185857.122660:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.122781:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48000 going to sleep for 11 seconds 00000100:00100000:0.0:1789185857.123123:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898480768 00000100:00100000:0.0:1789185857.123132:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898480768 00000100:00100000:0.0:1789185857.123210:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185857.123222:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+5:17134:x1876096898480768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789185857.123271:0:17150:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789185857.123274:0:17150:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789185857.123277:0:17150:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789185857.123656:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789185857.124088:0:17150:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1789185857.125565:0:17172:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789185857.125572:0:17172:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789185857.125575:0:17172:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789185857.125578:0:17172:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789185857.127199:0:17172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789185857.127682:0:17150:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789185857.127693:0:17150:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789185857.131631:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+5:17134:x1876096898480768:12345-0@lo:253:mount.lustre.0 Request processed in 8403us (8963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185857.131650:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185857.131716:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898480768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789185857.131730:0:17134:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789185857.131733:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789185857.131735:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789185857.131736:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185857.131738:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185857.131739:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185857.131740:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185857.131742:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789185857.131764:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789185857.131765:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185857.131766:0:17134:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789185857.131794:0:17134:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f1c41b6000 from lustre-MDT0000 10000000:01000000:1.0:1789185857.131824:0:17134:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789185857.131827:0:17134:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789185857.131831:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98f1c2073380 10000000:01000000:1.0:1789185857.131836:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789185857.131845:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98f1c2073380 from 1 10000000:01000000:1.0:1789185857.131848:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789185857.131891:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.131902:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.131931:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185857.131952:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898480896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789185857.132066:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.132109:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185857.132258:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898480896 00000100:00100000:3.0:1789185857.132265:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898480896 00000100:00100000:3.0:1789185857.132307:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185857.132316:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+5:17134:x1876096898480896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185857.132329:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185857.132344:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166d400/0xda5c730d5a73e87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73e80 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.132375:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166d400/0xda5c730d5a73e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73e80 expref: 6 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.132397:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166d400/0xda5c730d5a73e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73e80 expref: 6 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.132406:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166d400, rc 0) 00000100:00100000:3.0:1789185857.132447:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+6:17134:x1876096898480896:12345-0@lo:101:mount.lustre.0 Request processed in 132us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185857.132654:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898480896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185857.132668:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.132677:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185857.132725:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185857.132767:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.132796:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898481024 00000100:00100000:1.0:1789185857.132801:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898481024 00000100:00100000:1.0:1789185857.132819:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789185857.132825:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+7:17134:x1876096898481024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185857.132887:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+7:17134:x1876096898481024:12345-0@lo:501:mount.lustre.0 Request processed in 62us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789185857.132894:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789185857.132943:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185857.132953:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481024:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789185857.132974:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789185857.133059:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.133068:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185857.133076:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f1c41b6000 10000000:01000000:1.0:1789185857.133079:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789185857.133083:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f1c41b6000 10000000:01000000:1.0:1789185857.133085:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789185857.133088:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98f1c41b6000 from 1 10000000:01000000:1.0:1789185857.133090:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789185857.133104:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1c00/0xda5c730d5a73e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.133111:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1c00/0xda5c730d5a73e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.133129:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1c00/0xda5c730d5a73e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185857.133140:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789185857.133161:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.133178:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898481152 00000100:00100000:1.0:1789185857.133181:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898481152 00000100:00100000:1.0:1789185857.133195:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185857.133200:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+7:17134:x1876096898481152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185857.133206:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185857.133215:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2ff9c1600/0xda5c730d5a73e95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73e8e expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.133228:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2ff9c1600/0xda5c730d5a73e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73e8e expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.133236:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2ff9c1600/0xda5c730d5a73e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73e8e expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.133242:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1600, rc 0) 00000100:00100000:1.0:1789185857.133261:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+8:17134:x1876096898481152:12345-0@lo:101:mount.lustre.0 Request processed in 61us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185857.133266:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185857.133283:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185857.133292:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185857.134099:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1c00/0xda5c730d5a73e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e95 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.134123:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1c00/0xda5c730d5a73e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73e95 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185857.134135:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789185857.134139:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1c00/0xda5c730d5a73e8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e95 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.134145:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1c00/0xda5c730d5a73e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e95 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185857.134151:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789185857.134155:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789185857.134159:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f1c41b6000 10000000:01000000:1.0:1789185857.134162:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789185857.134165:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789185857.134168:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789185857.134190:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1a00/0xda5c730d5a73e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.134196:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1a00/0xda5c730d5a73e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.134203:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1a00/0xda5c730d5a73e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185857.134219:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789185857.134256:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.134293:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898481280 00000100:00100000:3.0:1789185857.134419:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789185857.134675:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898481280 00000100:00100000:1.0:1789185857.134768:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185857.134778:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+7:17134:x1876096898481280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185857.134799:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185857.134812:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2ff9c1e00/0xda5c730d5a73ea3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73e9c expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.134832:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2ff9c1e00/0xda5c730d5a73ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73e9c expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.134841:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2ff9c1e00/0xda5c730d5a73ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73e9c expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.134850:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1e00, rc 0) 00000100:00100000:1.0:1789185857.134883:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+8:17134:x1876096898481280:12345-0@lo:101:mount.lustre.0 Request processed in 107us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185857.134889:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185857.136697:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185857.136733:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185857.136827:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1a00/0xda5c730d5a73e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73ea3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185857.136841:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1a00/0xda5c730d5a73e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73ea3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185857.137133:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185857.137184:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.137258:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185857.137448:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898481408 00000100:00100000:3.0:1789185857.137530:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898481408 00000100:00100000:3.0:1789185857.137618:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789185857.137628:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+8:17134:x1876096898481408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185857.137804:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+9:17134:x1876096898481408:12345-0@lo:501:mount.lustre.0 Request processed in 177us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185857.137811:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185857.137889:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185857.137941:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185857.137999:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.138257:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.138466:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898481536 00000100:00100000:2.0:1789185857.138472:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898481536 00000100:00100000:2.0:1789185857.138498:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789185857.138505:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+9:17134:x1876096898481536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185857.142934:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+9:17134:x1876096898481536:12345-0@lo:503:mount.lustre.0 Request processed in 4398us (4905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.142950:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185857.143128:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898481536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185857.143739:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17173:1876096898481664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185857.143872:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185857.143944:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7a8e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789185857.144232:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898481664 00000100:00100000:3.0:1789185857.144239:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898481664 00000100:00100000:3.0:1789185857.144289:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185857.144306:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+9:17173:x1876096898481664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185857.145239:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+9:17173:x1876096898481664:12345-0@lo:502:llog_process_th.0 Request processed in 937us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185857.145249:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185857.145675:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17173:1876096898481664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789185857.145711:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185857.145723:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185857.145725:0:17173:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789185857.145730:0:17173:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789185857.145733:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185857.145747:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98f1c34eb380) 00000020:00000080:2.0:1789185857.145899:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789185857.145963:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789185857.146173:0:17173:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789185857.146190:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a73eb1 00000020:00000080:3.0:1789185857.147189:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789185857.147197:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185857.147212:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.147213:0:17173:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789185857.147218:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185857.147222:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.147223:0:17173:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789185857.147227:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789185857.147239:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98f1c2070000) 00000020:00000080:3.0:1789185857.147255:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789185857.147260:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789185857.147262:0:17173:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789185857.147265:0:17173:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789185857.147272:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789185857.147678:0:17173:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f1c41b6000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789185857.147694:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98f300184d40) 00000020:00000080:3.0:1789185857.147703:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789185857.148260:0:17173:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789185857.148269:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a73ec6 00000020:00000080:3.0:1789185857.148618:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789185857.148626:0:17173:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789185857.148632:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xda5c730d5a73ecd 00080000:01000000:3.0:1789185857.148639:0:17173:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789185857.148643:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a73ed4 00010000:00010000:2.0:1789185857.237550:0:17173:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789185857.238203:0:17173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1789185857.238884:0:17173:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789185857.239901:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98f1c34ecd40) 00000020:00000080:2.0:1789185857.239945:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789185857.240029:0:17173:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789185857.240037:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a73ee2 00000020:00000080:0.0:1789185857.241208:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789185857.249845:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xda5c730d5a73ee9 00000020:00000080:1.0:1789185857.250774:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789185857.250856:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185857.250865:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185857.250868:0:17173:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789185857.250872:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789185857.250876:0:17173:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789185857.250877:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789185857.250879:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789185857.250881:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789185857.250884:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185857.250885:0:17173:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789185857.250888:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185857.250893:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185857.250895:0:17173:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789185857.250899:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789185857.251142:0:17173:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789185857.251162:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185857.251166:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185857.251168:0:17173:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789185857.251170:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185857.251174:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185857.251175:0:17173:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789185857.251178:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789185857.251183:0:17173:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:00000080:1.0:1789185857.251230:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185857.251252:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98f2f75e4d40) 00000020:00000080:1.0:1789185857.251267:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789185857.251274:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789185857.251617:0:17173:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789185857.251622:0:17173:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789185857.251630:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a73ef7 00010000:00080000:1.0:1789185857.251662:0:17173:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c36a0800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.148@tcp at head 00010000:00010000:1.0:1789185857.255259:0:17173:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789185857.258089:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789185857.258105:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789185857.258145:0:17173:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789185857.258167:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a73efe 00000100:00080000:1.0:1789185857.258176:0:17173:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185857.258187:0:17173:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f1c36a0800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185857.258225:0:17173:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b2300 x1876096898481792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185857.258553:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898481792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789185857.258620:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185857.258753:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898481792 00000100:00100000:0.0:1789185857.258761:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898481792 00000100:00100000:0.0:1789185857.258812:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185857.258820:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898481792:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789185857.258837:0:17160:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1789185857.259111:0:17173:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789185857.262758:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185857.262767:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185857.262770:0:17173:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789185857.262774:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789185857.262777:0:17173:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789185857.262779:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789185857.262780:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789185857.262792:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789185857.262795:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185857.262797:0:17173:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789185857.262799:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789185857.262804:0:17173:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789185857.262807:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185857.262808:0:17173:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789185857.262826:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789185857.262831:0:17173:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:01000000:1.0:1789185857.262855:0:17173:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789185857.262858:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185857.262878:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98f2f75e0000) 00000020:00000080:1.0:1789185857.262899:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789185857.262904:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789185857.263022:0:17173:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789185857.263029:0:17173:0:(osd_handler.c:8926:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789185857.263036:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a73f0c 00010000:00080000:1.0:1789185857.263068:0:17173:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f30104b800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.148@tcp at head 00010000:00010000:1.0:1789185857.263308:0:17173:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789185857.268658:0:17173:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789185857.268953:0:17173:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789185857.272438:0:17173:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185857.272901:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789185857.273212:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789185857.274141:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789185857.274147:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789185857.286569:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789185857.286589:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789185857.286639:0:17173:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789185857.286662:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a73f13 00000100:00080000:2.0:1789185857.286673:0:17173:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789185857.286685:0:17173:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f30104b800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:2.0:1789185857.286722:0:17173:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b1180 x1876096898481920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789185857.286889:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898481920:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789185857.287202:0:17173:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789185857.287287:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185857.287302:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185857.287305:0:17173:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789185857.287308:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789185857.287311:0:17173:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789185857.287312:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789185857.287321:0:17173:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789185857.287323:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789185857.287325:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185857.287327:0:17173:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789185857.287330:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789185857.287334:0:17173:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789185857.287337:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185857.287339:0:17173:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789185857.287342:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789185857.287345:0:17173:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:01000000:2.0:1789185857.287368:0:17173:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789185857.287371:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1789185857.287547:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898481792:12345-0@lo:38:llog_process_th.0 Request processed in 28724us (28924us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789185857.287565:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:2.0:1789185857.287705:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98f1c34e99c0) 00000020:00000080:2.0:1789185857.287722:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789185857.287730:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789185857.287881:0:17173:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789185857.287888:0:17173:0:(osd_handler.c:8926:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789185857.287897:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xda5c730d5a73f21 00010000:00080000:2.0:1789185857.287957:0:17173:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f2f2752000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.148@tcp at head 00010000:00010000:2.0:1789185857.288278:0:17173:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000400:00000100:3.0:1789185857.288423:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898481920 offset 0 length 520: 4 00000100:00080000:3.0:1789185857.288497:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789185857.288503:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789185857.288507:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898481792:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1789185857.288778:0:17173:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789185857.288868:0:17173:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789185857.291799:0:17173:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185857.292139:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789185857.292270:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789185857.293135:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789185857.293141:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789185857.294043:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789185857.294059:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789185857.294104:0:17173:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789185857.294124:0:17173:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a73f28 00000100:00080000:0.0:1789185857.294134:0:17173:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789185857.294146:0:17173:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f2f2752000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185857.294185:0:17173:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758f100 x1876096898482048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185857.294203:0:17173:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789185857.294259:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185857.294263:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185857.294265:0:17173:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789185857.294268:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185857.294273:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185857.294274:0:17173:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789185857.294277:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789185857.294279:0:17173:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789185857.294282:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185857.294284:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185857.294285:0:17173:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789185857.294288:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185857.294290:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185857.294291:0:17173:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789185857.294307:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789185857.294343:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17173:1876096898482176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789185857.294440:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185857.294857:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.295622:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898482176 00000100:00100000:2.0:1789185857.295633:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898482176 00000100:00100000:2.0:1789185857.295694:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789185857.295705:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+9:17173:x1876096898482176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185857.295873:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+9:17173:x1876096898482176:12345-0@lo:502:llog_process_th.0 Request processed in 168us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.295881:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185857.296017:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898482048:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789185857.296052:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898482048 offset 0 length 520: 4 00000100:00100000:0.0:1789185857.296310:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17173:1876096898482176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789185857.296353:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185857.296359:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185857.296361:0:17173:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789185857.296366:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789185857.297164:0:17134:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789185857.297188:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789185857.297209:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1a00/0xda5c730d5a73e9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73ea3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.297221:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c1a00/0xda5c730d5a73e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73ea3 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185857.297229:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f1c41b6000 from 1 10000000:01000000:2.0:1789185857.297232:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789185857.297266:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.297275:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.297283:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185857.297530:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789185857.297581:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185857.297615:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d2827a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185857.297687:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898482304 00000100:00100000:0.0:1789185857.297694:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898482304 00000100:00100000:0.0:1789185857.297734:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789185857.297742:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+9:17134:x1876096898482304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185857.297754:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185857.297769:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73f2f expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185857.297803:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73f2f expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185857.297813:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73f2f expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185857.297820:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031200, rc 0) 00000100:00100000:0.0:1789185857.298086:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+10:17134:x1876096898482304:12345-0@lo:101:mount.lustre.0 Request processed in 343us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185857.298094:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185857.298277:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185857.298438:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.298515:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185857.299869:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482432:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789185857.300121:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185857.300199:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7a9a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185857.300253:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898482432 00000100:00100000:0.0:1789185857.300261:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898482432 00000100:00100000:0.0:1789185857.300343:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789185857.300354:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+10:17134:x1876096898482432:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789185857.300384:0:17147:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789185857.300391:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789185857.300725:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+10:17134:x1876096898482432:12345-0@lo:256:mount.lustre.0 Request processed in 372us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185857.300741:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185857.300819:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482432:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789185857.301477:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789185857.301498:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.301510:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185857.301518:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f1c41b6000 from 1 10000000:01000000:3.0:1789185857.301521:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185857.301552:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.301560:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.301569:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185857.301586:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789185857.301683:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185857.302584:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7a9a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.302670:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898482560 00000100:00100000:2.0:1789185857.302678:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898482560 00000100:00100000:2.0:1789185857.302718:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789185857.302726:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+10:17134:x1876096898482560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185857.302747:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185857.302764:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73f3d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.302804:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73f3d expref: 11 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.302815:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73f3d expref: 11 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.302825:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f000, rc 0) 00000100:00100000:2.0:1789185857.302933:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17134:x1876096898482560:12345-0@lo:101:mount.lustre.0 Request processed in 207us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.302940:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185857.303713:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185857.303734:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.303744:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185857.304101:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185857.304149:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185857.304239:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7a9a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.304291:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898482688 00000100:00100000:2.0:1789185857.304436:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898482688 00000100:00100000:2.0:1789185857.304593:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789185857.304604:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17134:x1876096898482688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185857.304761:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17134:x1876096898482688:12345-0@lo:501:mount.lustre.0 Request processed in 159us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.304769:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185857.304889:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185857.304951:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185857.305002:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185857.305287:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7a9a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.305504:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898482816 00000100:00100000:2.0:1789185857.305510:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898482816 00000100:00100000:2.0:1789185857.305531:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789185857.305537:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17134:x1876096898482816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185857.305636:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17134:x1876096898482816:12345-0@lo:503:mount.lustre.0 Request processed in 98us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.305653:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185857.305824:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898482816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185857.306363:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17183:1876096898482944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185857.306616:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185857.306650:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7a9a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.306712:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898482944 00000100:00100000:2.0:1789185857.306717:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898482944 00000100:00100000:2.0:1789185857.306743:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789185857.306749:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17183:x1876096898482944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185857.307346:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17183:x1876096898482944:12345-0@lo:502:llog_process_th.0 Request processed in 594us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.307355:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789185857.307560:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17183:1876096898482944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789185857.307596:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185857.307608:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.307610:0:17183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789185857.307620:0:17183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f1c41b6000 00000020:00000080:3.0:1789185857.307628:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789185857.307637:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185857.307640:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.307641:0:17183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789185857.307644:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185857.307647:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.307648:0:17183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789185857.307651:0:17183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f1c41b6000 00000020:00000080:3.0:1789185857.307654:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789185857.307717:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185857.307721:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.307723:0:17183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789185857.307725:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185857.307728:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.307729:0:17183:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789185857.307733:0:17183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f1c41b6000 00000020:00000080:3.0:1789185857.307734:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789185857.307751:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185857.307754:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.307755:0:17183:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789185857.307757:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789185857.307759:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.307760:0:17183:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789185857.307764:0:17183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f1c41b6000 00000020:00000080:3.0:1789185857.307766:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789185857.307865:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17183:1876096898483072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789185857.307938:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185857.307961:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d63dd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.308187:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898483072 00000100:00100000:2.0:1789185857.308193:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898483072 00000100:00100000:2.0:1789185857.308217:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789185857.308224:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17183:x1876096898483072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185857.308536:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17183:x1876096898483072:12345-0@lo:502:llog_process_th.0 Request processed in 310us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.308545:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185857.308677:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17183:1876096898483072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789185857.308699:0:17183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789185857.308704:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185857.308710:0:17183:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789185857.308714:0:17183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789185857.311417:0:17134:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789185857.312108:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185857.312128:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.312140:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185857.312199:0:17134:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789185857.312203:0:17134:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f1c41b6000 10000000:01000000:2.0:1789185857.312206:0:17134:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f1c41b6000 10000000:01000000:2.0:1789185857.312210:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789185857.312223:0:17134:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f1c41b6000 from 1 10000000:01000000:2.0:1789185857.312226:0:17134:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789185857.312261:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402ea00/0xda5c730d5a73f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.312269:0:17134:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c402ea00/0xda5c730d5a73f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.312280:0:17134:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c402ea00/0xda5c730d5a73f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185857.312313:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898483200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789185857.312391:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185857.312426:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1ba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.312463:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898483200 00000100:00100000:2.0:1789185857.312470:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898483200 00000100:00100000:2.0:1789185857.312508:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789185857.312516:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17134:x1876096898483200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185857.312529:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185857.312541:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402fc00/0xda5c730d5a73f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73f4b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.312577:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402fc00/0xda5c730d5a73f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73f4b expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.312588:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402fc00/0xda5c730d5a73f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73f4b expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.312597:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402fc00, rc 0) 00000100:00100000:2.0:1789185857.312635:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17134:x1876096898483200:12345-0@lo:101:mount.lustre.0 Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.312647:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789185857.312694:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898483200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185857.312707:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c402ea00/0xda5c730d5a73f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f52 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.312715:0:17134:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c402ea00/0xda5c730d5a73f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73f52 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185857.312762:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898483328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185857.312799:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185857.312813:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.312825:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898483328 00000100:00100000:2.0:1789185857.312829:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898483328 00000100:00100000:2.0:1789185857.312844:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789185857.312848:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17134:x1876096898483328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185857.312966:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17134:x1876096898483328:12345-0@lo:501:mount.lustre.0 Request processed in 117us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.312972:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789185857.313018:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898483328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185857.313046:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898483456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185857.313083:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185857.313096:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.313109:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898483456 00000100:00100000:2.0:1789185857.313113:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898483456 00000100:00100000:2.0:1789185857.313130:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789185857.313136:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17134:x1876096898483456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185857.313211:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17134:x1876096898483456:12345-0@lo:503:mount.lustre.0 Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.313218:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789185857.313259:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898483456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185857.315879:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17185:1876096898483584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185857.315975:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.316118:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018300 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.316182:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898483584 00000100:00100000:2.0:1789185857.316190:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898483584 00000100:00100000:2.0:1789185857.316234:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185857.316244:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17185:x1876096898483584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789185857.316616:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17185:x1876096898483584:12345-0@lo:502:llog_process_th.0 Request processed in 373us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.316624:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789185857.316719:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17185:1876096898483584:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789185857.316777:0:17185:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789185857.317562:0:17185:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98f2f75e19c0) 00000020:00000080:1.0:1789185857.317586:0:17185:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789185857.317685:0:17185:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f1c41b6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789185857.317690:0:17185:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f1c41b6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789185857.317692:0:17185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f1c41b6000 4 00010000:00080000:1.0:1789185857.317722:0:17185:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c36a3800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.148@tcp at head 00010000:00010000:1.0:1789185857.330204:0:17185:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789185857.331199:0:17185:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789185857.331243:0:17185:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789185857.331263:0:17185:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xda5c730d5a73f60 00000100:00080000:1.0:1789185857.331275:0:17185:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185857.331288:0:17185:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98f1c36a3800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185857.332926:0:17185:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b3b80 x1876096898483712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789185857.334080:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898483712:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789185857.334151:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789185857.334224:0:17185:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789185857.334652:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898483712 00000100:00100000:0.0:1789185857.334662:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898483712 00000100:00100000:0.0:1789185857.334699:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185857.334708:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898483712:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789185857.334775:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898483712:12345-0@lo:38:llog_process_th.0 Request processed in 67us (623us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789185857.334797:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185857.334844:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789185857.334852:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185857.334856:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789185857.334859:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898483712:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789185857.336288:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17185:1876096898483840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185857.336951:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.337715:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898483840 00000100:00100000:1.0:1789185857.337724:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898483840 00000100:00100000:1.0:1789185857.337774:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789185857.337932:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17185:x1876096898483840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185857.339178:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17185:x1876096898483840:12345-0@lo:502:llog_process_th.0 Request processed in 1392us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185857.339190:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789185857.339254:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185857.339280:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17185:1876096898483840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185857.339358:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17185:1876096898483968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185857.340649:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185857.340690:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898483968 00000100:00100000:1.0:1789185857.340696:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898483968 00000100:00100000:1.0:1789185857.340731:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789185857.340739:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17185:x1876096898483968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789185857.340861:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17185:x1876096898483968:12345-0@lo:502:llog_process_th.0 Request processed in 122us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185857.340868:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789185857.340927:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce018cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185857.340946:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17185:1876096898483968:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789185857.340973:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789185857.344898:0:17134:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789185857.344948:0:17134:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789185857.344966:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402ea00/0xda5c730d5a73f4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f52 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185857.345113:0:17134:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c402ea00/0xda5c730d5a73f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f52 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789185857.345168:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789185857.345171:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789185857.345173:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185857.345174:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185857.345175:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185857.345177:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185857.345178:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185857.345180:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789185857.345181:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185857.345183:0:17134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185857.345187:0:17134:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789185857.345195:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185857.345196:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789185857.345197:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185857.345198:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185857.345199:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185857.345200:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185857.345201:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185857.345202:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789185857.345203:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185857.345204:0:17134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185857.345230:0:17134:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789185857.345253:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898484096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789185857.346577:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185857.346617:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185857.346642:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898484096 00000100:00100000:2.0:1789185857.346649:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898484096 00000100:00100000:2.0:1789185857.346701:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789185857.346710:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17134:x1876096898484096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789185857.346739:0:17149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789185857.346751:0:17149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789185857.356160:0:17149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789185857.356175:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789185857.356756:0:17171:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789185857.356763:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789185857.356798:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185857.356818:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73f2f expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185857.356827:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185857.356868:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a73f2f expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185857.356884:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a73f2f expref: 12 pid: 17150 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185857.356934:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898484224:0@lo:104: 00000100:00100000:2.0:1789185857.357189:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17134:x1876096898484096:12345-0@lo:253:mount.lustre.0 Request processed in 10478us (10614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185857.357201:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789185857.357267:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17134:1876096898484096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789185857.357280:0:17134:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789185857.357283:0:17134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185857.357285:0:17134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789185857.357287:0:17134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185857.357288:0:17134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185857.357289:0:17134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185857.357310:0:17134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185857.357311:0:17134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185857.357313:0:17134:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789185857.357314:0:17134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185857.357316:0:17134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789185857.357332:0:17134:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789185857.358203:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185857.358254:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d2eb5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185857.358419:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898484224 00000100:00100000:3.0:1789185857.358427:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898484224 00000100:00100000:3.0:1789185857.358587:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185857.358597:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:17171:x1876096898484224:12345-0@lo:104: 00010000:00010000:3.0:1789185857.358613:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.358688:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185857.358694:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:17171:x1876096898484224:12345-0@lo:104: Request processed in 100us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185857.358701:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789185857.358731:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185857.358737:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.358745:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185857.358749:0:17144:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.358757:0:17144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185857.358765:0:17144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185857.358770:0:17144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789185857.358866:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898484224:0@lo:104: 00010000:00010000:0.0:1789185857.358882:0:17171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359554:0:17144:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359577:0:17144:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185857.359605:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359612:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f1c402f200/0xda5c730d5a73f2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a73f36 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359632:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185857.359634:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185857.359636:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185857.359664:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185857.359677:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898484352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185857.359720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185857.359764:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898484352 00000100:00100000:3.0:1789185857.359769:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898484352 00010000:00010000:3.0:1789185857.359811:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a73f2f expref: 12 pid: 17150 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185857.359837:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789185857.359844:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:3636:x1876096898484352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185857.359857:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185857.359862:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a73f2f expref: 12 pid: 17150 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359872:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a73f2f expref: 12 pid: 17150 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359885:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031200/0xda5c730d5a73f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a73f2f expref: 12 pid: 17150 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359923:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359932:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789185857.359946:0:17140:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003184452s 00010000:00010000:3.0:1789185857.359951:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359958:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359965:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.359972:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.365082:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185857.365090:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.365102:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.365129:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.365145:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185857.365235:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:3636:x1876096898484352:12345-0@lo:103:ldlm_bl.0 Request processed in 5387us (5510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185857.365247:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789185857.365291:0:17171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.365300:0:17171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185857.365307:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031000/0xda5c730d5a73f67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185857.365350:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898484352:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789185857.405718:0:17134:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789185857.407901:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789185857.408406:0:17195:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789185857.408412:0:17195:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789185857.410190:0:17196:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789185857.410396:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1789185857.412049:0:17197:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98f1c19b3b80 x1876096898484480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185857.412062:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00000040:00080000:1.0:1789185857.412173:0:17196:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789185857.413224:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789185857.413258:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789185857.414000:0:17134:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789185857.414011:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789185857.414057:0:17134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185857.415888:0:17134:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789185857.416655:0:17134:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789185857.416691:0:17134:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789185857.417575:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1789185857.417576:0:17134:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00000004:00080000:1.0:1789185857.417632:0:17196:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:1.0:1789185857.418574:0:17134:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1789185857.421059:0:17134:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789185857.422903:0:17134:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789185857.422956:0:17134:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb21ac1667988 00100000:10000000:1.0:1789185857.422964:0:17134:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789185857.427868:0:17134:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789185857.427886:0:17134:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789185857.427940:0:17134:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789185857.427958:0:17134:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789185857.428823:0:17134:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789185857.429063:0:17134:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789185857.958210:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789185858.422149:0:17191:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789185858.422159:0:17191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789185858.426043:0:17191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1789185858.426056:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789185858.471030:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 10000000:01000000:0.0:1789185858.599234:0:17153:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789185858.599241:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f1c41b6000 from 7 10000000:01000000:0.0:1789185858.599246:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789185858.599307:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185858.599320:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185858.599333:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185858.599365:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898484608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185858.599428:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185858.599477:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076000 going to sleep for 11 seconds 00000100:00100000:1.0:1789185858.599499:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898484608 00000100:00100000:1.0:1789185858.599508:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898484608 00000100:00100000:1.0:1789185858.599564:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789185858.599573:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+11:17153:x1876096898484608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185858.599587:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185858.599607:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73f6e expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185858.599633:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73f6e expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185858.599643:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73f6e expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185858.599653:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1400, rc 0) 00000100:00100000:1.0:1789185858.599699:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17153:x1876096898484608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185858.599706:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185858.601333:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898484608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185858.601356:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185858.601367:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185858.601435:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898484736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789185858.601486:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185858.601531:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076000 going to sleep for 11 seconds 00000100:00100000:3.0:1789185858.601554:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898484736 00000100:00100000:3.0:1789185858.601561:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898484736 00000100:00100000:3.0:1789185858.601613:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185858.601623:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17153:x1876096898484736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789185858.601640:0:17149:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789185858.601656:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789185858.601659:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789185858.601748:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17153:x1876096898484736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185858.601753:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898484736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789185858.601770:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 10000000:01000000:0.0:1789185858.601803:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789185858.601810:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185858.601818:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185858.983130:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789185859.442071:0:17191:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789185859.442081:0:17191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185859.442579:0:17191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789185859.442620:0:17191:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185859.442790:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:0.0:1789185859.517072:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:0.0:1789185860.015819:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185860.519414:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:3.0:1789185861.031197:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185861.544075:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:0.0:1789185862.054143:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789185862.567190:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789185862.567197:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789185862.567200:0:38:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789185862.567207:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1789185862.567213:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789185862.567224:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f1c36a0800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:2.0:1789185862.567248:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b3100 x1876096898484992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789185862.567264:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185862.567268:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789185862.567271:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185862.567274:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789185862.567284:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789185862.567287:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789185862.567289:0:38:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789185862.567296:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98f1c36a3800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:2.0:1789185862.567310:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b0380 x1876096898485120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185862.567347:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898484992:0@lo:38:kworker.0 00000100:00100000:2.0:1789185862.567411:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185862.567576:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185862.567589:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898484864:0@lo:400:kworker.0 00000100:00100000:1.0:1789185862.567772:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185862.567855:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898484864 00000100:00100000:1.0:1789185862.567863:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898484864 00000100:00100000:1.0:1789185862.567905:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185862.567934:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:3635:x1876096898484864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185862.567979:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:3635:x1876096898484864:12345-0@lo:400:kworker.0 Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185862.567986:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789185862.568028:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898484864:0@lo:400:kworker.0 00000100:00100000:2.0:1789185862.568147:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898485120:0@lo:38:kworker.0 00000100:00100000:2.0:1789185862.568183:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185862.568781:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898484992 00000100:00100000:3.0:1789185862.568790:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898484992 00000100:00100000:3.0:1789185862.568817:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185862.568822:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876096898484992:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789185862.568848:0:17161:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789185862.570264:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898485120 00000100:00100000:0.0:1789185862.570277:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898485120 00000100:00100000:0.0:1789185862.570318:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789185862.570325:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876096898485120:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789185862.570354:0:17157:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:0.0:1789185862.570387:0:17157:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xda5c730d5a73f7c 00000004:00100000:0.0:1789185862.570403:0:17157:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1789185862.570845:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00000100:00080000:0.0:1789185862.571227:0:17157:0:(import.c:65:import_set_state_nolock()) ffff98f2d27e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185862.572343:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876096898485120:12345-0@lo:38:kworker.0 Request processed in 2010us (4153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185862.572354:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789185862.577839:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f1c19b0380 x1876096898485120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789185862.577864:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789185862.577873:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789185862.577879:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789185862.577883:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789185862.577890:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876096898485120:0@lo:38:kworker.0 00000100:00100000:3.0:1789185862.609886:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876096898484992:12345-0@lo:38:kworker.0 Request processed in 41052us (42464us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789185862.609901:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789185862.610196:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185862.610203:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185862.610207:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898484992:0@lo:38:kworker.0 00000001:02000400:2.0:1789185862.904414:0:17440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789185863.078976:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185863.602535:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00000020:00000004:1.0:1789185863.986403:0:17492:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789185863.986850:0:17492:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789185864.103793:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185864.628730:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:2.0:1789185865.134266:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789185865.143716:0:17542:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789185865.144376:0:17542:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789185865.638684:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:3.0:1789185866.150224:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185866.662536:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:1.0:1789185867.174379:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789185867.686030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789185867.686038:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789185867.686041:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789185867.686050:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1789185867.686062:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789185867.686074:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f1c36a0800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185867.686114:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185867.686129:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898485248:0@lo:400:kworker.0 00000100:00100000:0.0:1789185867.686211:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185867.686281:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898485248 00000100:00100000:2.0:1789185867.686286:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185857/real 1789185857] req@ffff98f2f758f100 x1876096898482048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185867 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185867.686289:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898485248 00000100:00100000:2.0:1789185867.686307:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f2f758f100 x1876096898482048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185867 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185867.686316:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185857/real 1789185857] req@ffff98f1c19b1180 x1876096898481920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185867 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185867.686327:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f1c19b1180 x1876096898481920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185867 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789185867.686339:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1789185867.686339:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789185867.686347:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:3638:x1876096898485248:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789185867.686351:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789185867.686354:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898482048:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789185867.686359:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f30104b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789185867.686365:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789185867.686367:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898481920:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789185867.686394:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:3638:x1876096898485248:12345-0@lo:400:kworker.0 Request processed in 47us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185867.686407:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789185867.686453:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758fb80 x1876096898485376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185867.686474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185867.686478:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789185867.686479:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f30104b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185867.686483:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:0.0:1789185867.686486:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185867.686491:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f30104b800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185867.686502:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758e300 x1876096898485504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185867.686511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789185867.686514:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898485376:0@lo:38:kworker.0 00000100:00080000:0.0:1789185867.686514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789185867.686515:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185867.686518:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:0.0:1789185867.686521:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185867.686525:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f2f2752000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185867.686535:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758ce00 x1876096898485632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185867.686559:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185867.686565:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898485760:0@lo:400:kworker.0 00000100:00100000:2.0:1789185867.686596:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898485504:0@lo:8:kworker.0 00000100:00100000:0.0:1789185867.686604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:2.0:1789185867.686631:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898485504 offset 0 length 520: 4 00000100:00100000:0.0:1789185867.686631:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898485248:0@lo:400:kworker.0 00000100:00100000:2.0:1789185867.686643:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898485632:0@lo:8:kworker.0 00000400:00000100:2.0:1789185867.686660:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898485632 offset 0 length 520: 4 00000100:00100000:0.0:1789185867.686663:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898485760 00000100:00100000:0.0:1789185867.686669:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898485760 00000100:00100000:2.0:1789185867.686691:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898485376 00000100:00100000:2.0:1789185867.686694:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898485376 00000100:00100000:0.0:1789185867.686694:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185867.686699:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898485760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185867.686710:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185867.686714:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898485376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789185867.686730:0:17160:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789185867.686731:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898485760:12345-0@lo:400:kworker.0 Request processed in 32us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185867.686737:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789185867.686762:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f2f758d500 x1876096898485760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185867.686771:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898485760:0@lo:400:kworker.0 00000100:00100000:0.0:1789185867.690334:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00000100:00100000:0.0:1789185867.717366:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898485376:12345-0@lo:38:kworker.0 Request processed in 30642us (30799us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789185867.717380:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789185867.717717:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789185867.717722:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789185867.717727:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898485376:0@lo:38:kworker.0 00010000:00010000:3.0:1789185868.198164:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185868.710205:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:1.0:1789185869.222273:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185869.671830:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789185869.735154:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:3.0:1789185870.246860:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185870.758296:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:1.0:1789185871.272383:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185871.782377:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:3.0:1789185872.296398:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185872.805993:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00000100:00080000:0.0:1789185872.807800:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789185872.807807:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789185872.807811:0:38:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185872.807819:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:0.0:1789185872.807825:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789185872.807837:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f1c36a0800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185872.807863:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758d180 x1876096898486016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185872.807886:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185872.807890:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185872.807893:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185872.807942:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789185872.807993:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898486016:0@lo:38:kworker.0 00000100:00100000:0.0:1789185872.808071:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185872.808142:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898486016 00000100:00100000:0.0:1789185872.808151:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898486016 00000100:00100000:0.0:1789185872.808189:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185872.808196:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876096898486016:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789185872.808218:0:17161:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789185872.809095:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898485888:0@lo:400:kworker.0 00000100:00100000:1.0:1789185872.809143:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185872.809186:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789185872.809192:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898486144:0@lo:400:kworker.0 00000100:00100000:1.0:1789185872.809216:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185872.809980:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898486144 00000100:00100000:1.0:1789185872.809988:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898486144 00000100:00100000:1.0:1789185872.810031:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185872.810039:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898486144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185872.810096:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898486144:12345-0@lo:400:kworker.0 Request processed in 58us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185872.810103:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789185872.810141:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f2f758fb80 x1876096898486144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185872.810154:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898486144:0@lo:400:kworker.0 00000100:00100000:2.0:1789185872.813563:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898485888 00000100:00100000:2.0:1789185872.813578:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898485888 00000100:00100000:2.0:1789185872.813633:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789185872.813643:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:3635:x1876096898485888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185872.813730:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:3635:x1876096898485888:12345-0@lo:400:kworker.0 Request processed in 88us (4585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185872.813737:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789185872.813808:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898485888:0@lo:400:kworker.0 00000100:00100000:0.0:1789185872.827036:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876096898486016:12345-0@lo:38:kworker.0 Request processed in 18830us (18967us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789185872.827050:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789185872.827160:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185872.827166:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185872.827170:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898486016:0@lo:38:kworker.0 00000020:01000004:2.0:1789185873.159721:0:17887:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789185873.159725:0:17887:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789185873.159727:0:17887:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789185873.159838:0:17887:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98f1c316e800 00000020:01000004:2.0:1789185873.159853:0:17887:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789185873.159866:0:17887:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789185873.159880:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff98f1c34e8000) 00000020:00000080:2.0:1789185873.159897:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789185873.245566:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789185873.245833:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789185873.252613:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.253108:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.253304:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.253588:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.253815:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.254148:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.254347:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.254654:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.254845:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.255113:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.258277:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.258827:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.259082:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.259327:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.259596:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.260073:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.260308:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.260561:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.260801:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.261096:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.261297:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789185873.261541:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789185873.261737:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789185873.264314:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789185873.265069:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789185873.265557:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789185873.265758:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789185873.266684:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789185873.266942:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789185873.267140:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789185873.267327:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789185873.267759:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789185873.269852:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789185873.271169:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789185873.271627:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789185873.271804:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789185873.272175:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789185873.272573:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789185873.272810:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789185873.273018:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789185873.273212:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789185873.273414:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789185873.273617:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789185873.273869:0:17887:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1789185873.275308:0:17887:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789185873.276960:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789185873.276976:0:17887:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789185873.276995:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a73f8a 00000020:01000004:3.0:1789185873.277002:0:17887:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789185873.277023:0:17887:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789185873.277028:0:17887:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789185873.277034:0:17887:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789185873.277063:0:17887:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789185873.277068:0:17887:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.148@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789185873.283161:0:17887:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789185873.283205:0:17887:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.148@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789185873.283210:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789185873.283211:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789185873.283213:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185873.283214:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185873.283215:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185873.283217:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185873.283218:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185873.283220:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185873.283221:0:17887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185873.283225:0:17887:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789185873.283227:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789185873.283228:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789185873.283230:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185873.283235:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185873.283236:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185873.283237:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185873.283238:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789185873.283239:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185873.283240:0:17887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789185873.283267:0:17887:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789185873.283285:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486272:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789185873.283358:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185873.283495:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1ba3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185873.283586:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898486272 00000100:00100000:1.0:1789185873.283595:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898486272 00000100:00100000:1.0:1789185873.283760:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789185873.283770:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17887:x1876096898486272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789185873.283800:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789185873.283803:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789185873.283811:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789185873.284345:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17887:x1876096898486272:12345-0@lo:253:mount.lustre.0 Request processed in 569us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185873.284364:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789185873.284464:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789185873.284476:0:17887:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789185873.284492:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789185873.284493:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789185873.284495:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185873.284496:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185873.284497:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185873.284498:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185873.284499:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789185873.284500:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185873.284501:0:17887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789185873.284521:0:17887:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f1c316e800 from lustre-MDT0001 10000000:01000000:0.0:1789185873.284554:0:17887:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789185873.284557:0:17887:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789185873.284564:0:17887:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f1c2073380 local copy 00010000:00010000:0.0:1789185873.284573:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185873.284839:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185873.284874:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.289728:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185873.291249:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898486400 00000100:00100000:2.0:1789185873.291264:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898486400 00000100:00100000:2.0:1789185873.291325:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185873.291334:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17887:x1876096898486400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185873.291476:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17887:x1876096898486400:12345-0@lo:501:mount.lustre.0 Request processed in 142us (6600us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185873.291706:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486400:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789185873.291733:0:17887:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789185873.291758:0:17887:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789185873.291766:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.291777:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185873.291816:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f1c316e800 10000000:01000000:0.0:1789185873.291821:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789185873.291826:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98f1c2073380 10000000:01000000:0.0:1789185873.291828:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789185873.291832:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98f1c2073380 from 1 10000000:01000000:0.0:1789185873.291834:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789185873.291865:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031e00/0xda5c730d5a73f91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.291874:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031e00/0xda5c730d5a73f91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.291902:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031e00/0xda5c730d5a73f91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185873.291944:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185873.291981:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.292004:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185873.292190:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185873.292219:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898486528 00000100:00100000:2.0:1789185873.292223:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898486528 00000100:00100000:2.0:1789185873.292243:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789185873.292250:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+12:17887:x1876096898486528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185873.292259:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185873.292273:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402f800/0xda5c730d5a73f98 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73f91 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.292294:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402f800/0xda5c730d5a73f98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73f91 expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.292305:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402f800/0xda5c730d5a73f98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73f91 expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.292314:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f800, rc 0) 00000100:00100000:2.0:1789185873.292356:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+13:17887:x1876096898486528:12345-0@lo:101:mount.lustre.0 Request processed in 106us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185873.292362:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789185873.292445:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185873.292458:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031e00/0xda5c730d5a73f91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f98 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.292467:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031e00/0xda5c730d5a73f91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73f98 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185873.292559:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789185873.292577:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031e00/0xda5c730d5a73f91 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f98 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.292585:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031e00/0xda5c730d5a73f91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73f98 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185873.292592:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f1c316e800 10000000:01000000:0.0:1789185873.292596:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789185873.292600:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98f1c316e800 from 1 10000000:01000000:0.0:1789185873.292602:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789185873.292619:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a73f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.292626:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a73f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.292640:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a73f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185873.292653:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185873.292779:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.292801:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185873.292863:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898486656 00000100:00100000:2.0:1789185873.292867:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898486656 00000100:00100000:2.0:1789185873.292887:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789185873.292894:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+13:17887:x1876096898486656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185873.292901:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185873.292936:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402f200/0xda5c730d5a73fa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73f9f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.292951:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402f200/0xda5c730d5a73fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73f9f expref: 14 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.292966:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402f200/0xda5c730d5a73fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73f9f expref: 14 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.292973:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f200, rc 0) 00000100:00100000:2.0:1789185873.293000:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+14:17887:x1876096898486656:12345-0@lo:101:mount.lustre.0 Request processed in 107us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185873.293006:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789185873.293077:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185873.293087:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a73f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73fa6 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.293095:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a73f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73fa6 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185873.293112:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789185873.293165:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a73f9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73fa6 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.293173:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0030000/0xda5c730d5a73f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73fa6 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185873.293179:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789185873.293184:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789185873.293188:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f1c316e800 10000000:01000000:0.0:1789185873.293191:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789185873.293194:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789185873.293197:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789185873.293212:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030400/0xda5c730d5a73fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.293224:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0030400/0xda5c730d5a73fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.293232:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0030400/0xda5c730d5a73fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185873.293245:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185873.293271:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.293291:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.293368:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898486784 00000100:00100000:3.0:1789185873.293373:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898486784 00000100:00100000:3.0:1789185873.293398:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789185873.293405:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+14:17887:x1876096898486784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185873.293412:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185873.293421:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166c400/0xda5c730d5a73fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a73fad expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.293434:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166c400/0xda5c730d5a73fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a73fad expref: 15 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.293442:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166c400/0xda5c730d5a73fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73fad expref: 15 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.293447:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166c400, rc 0) 00000100:00100000:3.0:1789185873.293472:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898486784:12345-0@lo:101:mount.lustre.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.293492:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789185873.293710:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185873.293720:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0030400/0xda5c730d5a73fad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73fb4 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.293728:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030400/0xda5c730d5a73fad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a73fb4 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789185873.295446:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1789185873.296254:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185873.303208:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789185873.303273:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789185873.303290:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789185873.303302:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789185873.303313:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1789185873.303325:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1789185873.303336:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1789185873.303348:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789185873.303360:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789185873.303371:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1789185873.303383:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1789185873.303405:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1789185873.303417:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1789185873.303428:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789185873.303442:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789185873.303455:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1789185873.303467:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789185873.303548:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789185873.303567:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1789185873.303579:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789185873.303594:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789185873.303605:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789185873.303614:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789185873.303636:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1789185873.303640:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1789185873.303827:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185873.303898:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.304088:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.304134:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898486912 00000100:00100000:3.0:1789185873.304142:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898486912 00000100:00100000:3.0:1789185873.304312:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789185873.304323:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898486912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185873.304509:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898486912:12345-0@lo:501:mount.lustre.0 Request processed in 187us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.304517:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789185873.304592:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898486912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185873.304624:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898487040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789185873.304659:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.304953:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789185873.305085:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898487040 00000100:00100000:1.0:1789185873.305092:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898487040 00000100:00100000:1.0:1789185873.305120:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789185873.305126:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898487040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185873.305898:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898487040:12345-0@lo:503:mount.lustre.0 Request processed in 768us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185873.305928:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789185873.306167:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898487040:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789185873.306761:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789185873.306838:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898487168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185873.306886:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.307039:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185873.307107:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898487168 00000100:00100000:1.0:1789185873.307113:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898487168 00000100:00100000:1.0:1789185873.307189:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789185873.307199:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898487168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185873.307792:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898487168:12345-0@lo:502:mount.lustre.0 Request processed in 593us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185873.307800:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789185873.307877:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898487168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789185873.308084:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789185873.308111:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789185873.308127:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789185873.308140:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789185873.308152:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789185873.308164:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789185873.308176:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789185873.308188:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789185873.308201:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789185873.308214:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789185873.308226:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789185873.308239:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789185873.308252:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789185873.308279:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789185873.308293:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789185873.308305:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789185873.308317:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789185873.308332:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789185873.308345:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789185873.308358:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789185873.308370:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789185873.308383:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789185873.308396:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789185873.308409:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789185873.308422:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789185873.308435:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789185873.308448:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789185873.308458:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789185873.308473:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789185873.308503:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789185873.308516:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789185873.308527:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789185873.308552:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789185873.308565:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789185873.308576:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789185873.308588:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789185873.308599:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789185873.308610:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789185873.308625:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789185873.308637:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789185873.308649:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789185873.308673:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789185873.308689:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789185873.308701:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789185873.308736:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898487296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185873.308787:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.309416:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.309511:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898487296 00000100:00100000:3.0:1789185873.309518:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898487296 00000100:00100000:3.0:1789185873.309559:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789185873.309567:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898487296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185873.309824:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898487296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789185873.309880:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1789185873.309892:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000100:00100000:3.0:1789185873.310284:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898487296:12345-0@lo:502:mount.lustre.0 Request processed in 139us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.310296:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:01000000:1.0:1789185873.310886:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185873.310898:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185873.310901:0:17891:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789185873.311030:0:17891:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789185873.311035:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185873.311050:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff98f300388000) 00000020:00000080:1.0:1789185873.311074:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789185873.311081:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789185873.311154:0:17891:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789185873.311160:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a73fc2 00000020:00000080:1.0:1789185873.311354:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789185873.311359:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185873.311362:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185873.311371:0:17891:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789185873.311374:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185873.311378:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185873.311379:0:17891:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789185873.311382:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789185873.311389:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff98f30038cd40) 00000020:00000080:1.0:1789185873.311399:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789185873.311402:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789185873.311404:0:17891:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789185873.311407:0:17891:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789185873.311412:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789185873.311463:0:17891:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f1c316e800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789185873.311477:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff98f3003899c0) 00000020:00000080:1.0:1789185873.311556:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789185873.311607:0:17891:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789185873.311612:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a73fd7 00000020:00000080:1.0:1789185873.311748:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789185873.311755:0:17891:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789185873.311760:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xda5c730d5a73fde 00080000:01000000:1.0:1789185873.311765:0:17891:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789185873.311768:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a73fe5 00010000:00010000:2.0:1789185873.319030:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185873.389843:0:17891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789185873.390581:0:17891:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789185873.390858:0:17891:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789185873.391721:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789185873.391734:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789185873.391740:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185873.391742:0:17891:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789185873.391746:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789185873.391750:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185873.391752:0:17891:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789185873.391754:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789185873.391760:0:17891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:00000080:2.0:1789185873.391787:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185873.391801:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff98f2c6fd4d40) 00000020:00000080:2.0:1789185873.391823:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789185873.391828:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789185873.391939:0:17891:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789185873.391947:0:17891:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789185873.391954:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a73ff3 00010000:00080000:2.0:1789185873.391985:0:17891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f2d0b94800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.148@tcp at head 00010000:00010000:2.0:1789185873.393640:0:17891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789185873.397934:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789185873.397952:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789185873.397990:0:17891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789185873.398011:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a73ffa 00000100:00080000:0.0:1789185873.398021:0:17891:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789185873.398034:0:17891:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98f2d0b94800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185873.398072:0:17891:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758d180 x1876096898487424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185873.398101:0:17891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789185873.398148:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185873.398152:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.398161:0:17891:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789185873.398164:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789185873.398167:0:17891:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789185873.398169:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789185873.398171:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789185873.398172:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789185873.398174:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.398176:0:17891:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789185873.398178:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185873.398182:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.398184:0:17891:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789185873.398188:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789185873.398218:0:17891:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789185873.398230:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185873.398232:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.398234:0:17891:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789185873.398236:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789185873.398238:0:17891:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789185873.398239:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789185873.398241:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789185873.398243:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789185873.398245:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.398246:0:17891:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789185873.398249:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789185873.398252:0:17891:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789185873.398255:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.398257:0:17891:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789185873.398259:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789185873.398263:0:17891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:01000000:0.0:1789185873.398285:0:17891:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789185873.398288:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789185873.398301:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98f1c34b8000) 00000020:00000080:0.0:1789185873.398312:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789185873.398317:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789185873.398374:0:17891:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789185873.398380:0:17891:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789185873.398386:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a74008 00010000:00080000:0.0:1789185873.398414:0:17891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c3526000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.148@tcp at head 00000100:00100000:2.0:1789185873.398597:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898487424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789185873.398674:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789185873.398738:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789185873.398742:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789185873.398745:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789185873.398750:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1789185873.398753:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789185873.398759:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f1c36a0800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:2.0:1789185873.398775:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c19b2300 x1876096898487552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789185873.398790:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185873.398795:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789185873.398797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185873.398800:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789185873.398839:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898487424 00000100:00100000:2.0:1789185873.398847:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898487424 00000100:00100000:2.0:1789185873.398878:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789185873.398885:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898487424:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789185873.398932:0:17160:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:2.0:1789185873.398960:0:17160:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a7400f 00000004:00100000:2.0:1789185873.398974:0:17160:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789185873.398980:0:17160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789185873.399059:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898487680:0@lo:400:kworker.0 00000100:00100000:2.0:1789185873.399091:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185873.399134:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898487680 00000100:00100000:2.0:1789185873.399143:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898487680 00000100:00100000:2.0:1789185873.399180:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185873.399186:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898487680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185873.399230:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898487680:12345-0@lo:400:kworker.0 Request processed in 44us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185873.399236:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789185873.399274:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f1c19b2d80 x1876096898487680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185873.399288:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898487680:0@lo:400:kworker.0 00000100:00100000:2.0:1789185873.399308:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898487552:0@lo:38:kworker.0 00000100:00100000:2.0:1789185873.399330:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185873.399355:0:17161:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789185873.399362:0:17161:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:0.0:1789185873.399735:0:17891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1789185873.400166:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898487552 00000100:00100000:2.0:1789185873.400172:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898487552 00000100:00100000:2.0:1789185873.400259:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789185873.400265:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1876096898487552:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789185873.400321:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1876096898487552:12345-0@lo:38:kworker.0 Request processed in 55us (989us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789185873.400328:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789185873.400355:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789185873.400363:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789185873.400367:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789185873.400370:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898487552:0@lo:38:kworker.0 00000040:01000000:0.0:1789185873.401301:0:17891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789185873.402593:0:17891:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789185873.405099:0:17891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185873.405721:0:17891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789185873.405853:0:17891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1789185873.415268:0:17897:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789185873.415276:0:17897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789185873.417170:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789185873.417181:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789185873.417215:0:17891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789185873.417236:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a74016 00000100:00080000:0.0:1789185873.417245:0:17891:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789185873.417255:0:17891:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f1c3526000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185873.417291:0:17891:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758ca80 x1876096898487808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185873.417309:0:17891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789185873.417355:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185873.417359:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.417361:0:17891:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789185873.417363:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789185873.417366:0:17891:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789185873.417367:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789185873.417369:0:17891:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789185873.417370:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789185873.417372:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.417373:0:17891:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789185873.417375:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789185873.417380:0:17891:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789185873.417383:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.417390:0:17891:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789185873.417394:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789185873.417397:0:17891:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.148@tcp to nid 0x20000c0a8cc94 (192.168.204.148@tcp) 00000020:01000000:0.0:1789185873.417416:0:17891:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789185873.417418:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789185873.417429:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98f1c34bb380) 00000020:00000080:0.0:1789185873.417440:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1789185873.417444:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1789185873.417585:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898487808:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789185873.417631:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898487808 offset 0 length 520: 4 00000100:00080000:1.0:1789185873.417796:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789185873.417801:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789185873.417805:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789185873.417808:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:0.0:1789185873.417934:0:17891:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789185873.417941:0:17891:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789185873.417948:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xda5c730d5a74024 00010000:00080000:0.0:1789185873.417980:0:17891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f2c7c41800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.148@tcp at head 00010000:00010000:0.0:1789185873.418181:0:17891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789185873.418246:0:17891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789185873.418261:0:17891:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789185873.419869:0:17160:0:(import.c:65:import_set_state_nolock()) ffff98f2c7f9d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185873.422310:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876096898487424:12345-0@lo:38:llog_process_th.0 Request processed in 23416us (23627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.422325:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1789185873.422626:0:17891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185873.423396:0:17891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789185873.423571:0:17891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:2.0:1789185873.424210:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789185873.424224:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789185873.424233:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789185873.424239:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789185873.424242:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2d0b94800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789185873.424267:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898487424:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789185873.424409:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185873.424431:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898487936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185873.424503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.424577:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898487936 00000100:00100000:0.0:1789185873.424584:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898487936 00000100:00100000:0.0:1789185873.424623:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185873.424632:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898487936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185873.424663:0:17161:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789185873.424734:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1876096898487936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185873.424741:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185873.425085:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898487936:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789185873.425401:0:17899:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789185873.425406:0:17899:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789185873.426366:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789185873.426377:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789185873.426413:0:17891:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789185873.426434:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a7402b 00000100:00080000:1.0:1789185873.426441:0:17891:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185873.426450:0:17891:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f2c7c41800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185873.426868:0:17891:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b1500 x1876096898488064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789185873.427148:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898488064:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789185873.427209:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898488064 offset 0 length 520: 4 00000100:00080000:1.0:1789185873.427300:0:17891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789185873.427358:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185873.427362:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185873.427364:0:17891:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789185873.427367:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185873.427371:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185873.427372:0:17891:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789185873.427375:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789185873.427377:0:17891:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789185873.427379:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185873.427381:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185873.427382:0:17891:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789185873.427384:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185873.427386:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185873.427387:0:17891:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789185873.427391:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789185873.427416:0:17891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185873.427418:0:17891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185873.427420:0:17891:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789185873.427422:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789185873.427591:0:17887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789185873.427621:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789185873.427637:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030400/0xda5c730d5a73fad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73fb4 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.427649:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0030400/0xda5c730d5a73fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73fb4 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185873.427670:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f1c316e800 from 1 10000000:01000000:0.0:1789185873.427673:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789185873.427709:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.427717:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.427728:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185873.427742:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185873.427780:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.427806:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7544f00 going to sleep for 11 seconds 00000100:00080000:3.0:1789185873.427956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185873.427961:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185873.427964:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185873.427967:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789185873.428325:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898488192 00000100:00100000:1.0:1789185873.428333:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898488192 00000100:00100000:1.0:1789185873.428375:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789185873.428383:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+15:17887:x1876096898488192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185873.428396:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185873.428409:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a74032 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185873.428431:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a74032 expref: 16 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185873.428441:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74032 expref: 16 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185873.428450:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1800, rc 0) 00000100:00100000:1.0:1789185873.428511:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+16:17887:x1876096898488192:12345-0@lo:101:mount.lustre.0 Request processed in 129us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185873.428518:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789185873.428601:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185873.428616:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.428624:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185873.429540:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488320:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789185873.429604:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.429640:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7544f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.430027:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898488320 00000100:00100000:3.0:1789185873.430035:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898488320 00000100:00100000:3.0:1789185873.430176:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789185873.430185:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+16:17887:x1876096898488320:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789185873.430205:0:17147:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789185873.430224:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789185873.430232:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789185873.430388:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+16:17887:x1876096898488320:12345-0@lo:256:mount.lustre.0 Request processed in 204us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.430395:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789185873.430542:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488320:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789185873.433306:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789185873.433346:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.433360:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185873.433370:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f1c316e800 from 1 10000000:01000000:0.0:1789185873.433373:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185873.433410:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.433418:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.433429:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185873.433451:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185873.433529:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185873.433683:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898488448 00000100:00100000:2.0:1789185873.433691:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898488448 00000100:00100000:2.0:1789185873.433737:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789185873.433746:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+16:17887:x1876096898488448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185873.433760:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185873.433774:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a74040 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.433801:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a74040 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.433811:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74040 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.433820:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f600, rc 0) 00000100:00100000:2.0:1789185873.433854:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898488448:12345-0@lo:101:mount.lustre.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185873.433869:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789185873.434283:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7544f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185873.434308:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185873.434323:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.434332:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789185873.434489:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789185873.434522:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185873.434792:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.434823:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7544c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185873.434872:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898488576 00000100:00100000:2.0:1789185873.434877:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898488576 00000100:00100000:3.0:1789185873.435013:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789185873.435023:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898488576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185873.435118:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898488576:12345-0@lo:501:mount.lustre.0 Request processed in 97us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.435125:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789185873.435216:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185873.435243:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789185873.435283:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.435299:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7544c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.435344:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898488704 00000100:00100000:3.0:1789185873.435351:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898488704 00000100:00100000:3.0:1789185873.435386:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789185873.435392:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898488704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185873.435472:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898488704:12345-0@lo:503:mount.lustre.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.435495:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789185873.435536:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488704:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789185873.435898:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789185873.436197:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185873.436241:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185873.436259:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.436277:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898488832 00000100:00100000:3.0:1789185873.436282:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898488832 00000100:00100000:3.0:1789185873.436302:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185873.436309:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898488832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185873.436397:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898488832:12345-0@lo:502:mount.lustre.0 Request processed in 88us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.436410:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185873.436450:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185873.436771:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789185873.436797:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789185873.436812:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789185873.436828:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789185873.436840:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789185873.436852:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789185873.436863:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789185873.436876:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1789185873.436889:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789185873.436902:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1789185873.437010:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1789185873.437036:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185873.437073:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185873.437088:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.437104:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898488960 00000100:00100000:3.0:1789185873.437108:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898488960 00000100:00100000:3.0:1789185873.437127:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789185873.437132:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898488960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185873.437197:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898488960:12345-0@lo:502:mount.lustre.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.437203:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789185873.437238:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898488960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185873.437273:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1789185873.437280:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789185873.438225:0:17901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185873.438235:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.438238:0:17901:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789185873.438245:0:17901:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f1c316e800 00000020:00000080:0.0:1789185873.438249:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185873.438257:0:17901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185873.438259:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.438260:0:17901:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789185873.438262:0:17901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185873.438264:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.438265:0:17901:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789185873.438268:0:17901:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f1c316e800 00000020:00000080:0.0:1789185873.438270:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185873.438371:0:17901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185873.438375:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.438376:0:17901:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789185873.438379:0:17901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185873.438381:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.438382:0:17901:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185873.438386:0:17901:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f1c316e800 00000020:00000080:0.0:1789185873.438387:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185873.442064:0:17901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185873.442080:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.442082:0:17901:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185873.442087:0:17901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185873.442098:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.442100:0:17901:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789185873.442107:0:17901:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f1c316e800 00000020:00000080:0.0:1789185873.442109:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185873.442178:0:17901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185873.442182:0:17901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185873.442184:0:17901:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789185873.442187:0:17901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789185873.442708:0:17887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789185873.442741:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185873.444622:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185873.444641:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185873.444741:0:17887:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789185873.444744:0:17887:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f1c316e800 10000000:01000000:1.0:1789185873.444747:0:17887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f1c316e800 10000000:01000000:1.0:1789185873.444752:0:17887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789185873.444767:0:17887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f1c316e800 from 1 10000000:01000000:1.0:1789185873.444770:0:17887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789185873.444811:0:17887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0600/0xda5c730d5a7404e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185873.444821:0:17887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0600/0xda5c730d5a7404e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185873.444832:0:17887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0600/0xda5c730d5a7404e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185873.444856:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789185873.445068:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185873.445111:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6153600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.446443:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898489088 00000100:00100000:3.0:1789185873.446459:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898489088 00000100:00100000:3.0:1789185873.446530:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789185873.446541:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17887:x1876096898489088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185873.446557:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185873.446734:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166d200/0xda5c730d5a74055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a7404e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.446766:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166d200/0xda5c730d5a74055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a7404e expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.446778:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166d200/0xda5c730d5a74055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7404e expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.446786:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166d200, rc 0) 00000100:00100000:3.0:1789185873.446858:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489088:12345-0@lo:101:mount.lustre.0 Request processed in 319us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.446865:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789185873.447041:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185873.447058:0:17887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0600/0xda5c730d5a7404e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74055 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185873.447068:0:17887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0600/0xda5c730d5a7404e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74055 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185873.459330:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789185873.459873:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185873.460318:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789185873.460347:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1789185873.460363:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1789185873.460374:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1789185873.460386:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1789185873.460398:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1789185873.460410:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1789185873.460423:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1789185873.460437:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1789185873.460450:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1789185873.460462:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1789185873.460473:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1789185873.460658:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1789185873.460673:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1789185873.460686:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1789185873.460699:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1789185873.460711:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1789185873.460723:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1789185873.460735:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1789185873.460747:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1789185873.460758:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1789185873.460771:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1789185873.460783:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1789185873.460796:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1789185873.460811:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1789185873.460825:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1789185873.460851:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1789185873.460863:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1789185873.460881:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1789185873.460886:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789185873.462901:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185873.463686:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185873.463737:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898489216 00000100:00100000:2.0:1789185873.463743:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898489216 00000100:00100000:2.0:1789185873.463788:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185873.463796:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185873.464111:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489216:12345-0@lo:501:mount.lustre.0 Request processed in 112us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185873.464120:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185873.464164:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d33c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185873.464184:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185873.464217:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185873.464254:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185873.464276:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d33c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.464418:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898489344 00000100:00100000:3.0:1789185873.464423:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898489344 00000100:00100000:3.0:1789185873.464874:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789185873.464885:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185873.465087:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489344:12345-0@lo:503:mount.lustre.0 Request processed in 204us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.465094:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789185873.466630:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789185873.467194:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789185873.467269:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185873.467332:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.473866:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898489472 00000100:00100000:0.0:1789185873.473883:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898489472 00000100:00100000:0.0:1789185873.473966:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789185873.473975:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185873.474113:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489472:12345-0@lo:502:mount.lustre.0 Request processed in 139us (6781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185873.474121:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789185873.477091:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d33c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.477140:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185873.477399:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789185873.477433:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1789185873.477458:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1789185873.477471:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1789185873.477568:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1789185873.477657:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1789185873.477670:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1789185873.477683:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1789185873.477696:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1789185873.477709:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1789185873.477720:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1789185873.477731:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1789185873.477742:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1789185873.477753:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1789185873.477765:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1789185873.477777:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1789185873.477788:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1789185873.477802:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1789185873.477829:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1789185873.477841:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1789185873.477853:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1789185873.477864:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1789185873.477875:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1789185873.477886:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1789185873.477897:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1789185873.478651:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1789185873.478681:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1789185873.478695:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1789185873.478708:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1789185873.478719:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1789185873.478731:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1789185873.478743:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1789185873.478755:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1789185873.478766:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1789185873.478791:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1789185873.478815:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1789185873.478829:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1789185873.478844:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1789185873.478858:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1789185873.478871:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1789185873.478882:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1789185873.478892:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1789185873.478904:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1789185873.478948:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1789185873.478960:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1789185873.478970:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1789185873.478982:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1789185873.478994:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1789185873.479048:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185873.479125:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185873.479166:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185873.479337:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898489600 00000100:00100000:0.0:1789185873.479345:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898489600 00000100:00100000:0.0:1789185873.479394:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789185873.479403:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185873.479530:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489600:12345-0@lo:502:mount.lustre.0 Request processed in 127us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185873.479538:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789185873.481748:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185873.482327:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1789185873.482372:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1789185873.482409:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185873.482471:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185873.482964:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185873.483282:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898489728 00000100:00100000:0.0:1789185873.483291:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898489728 00000100:00100000:0.0:1789185873.483340:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185873.483350:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185873.483746:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789185873.483813:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1789185873.483825:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:0.0:1789185873.484238:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489728:12345-0@lo:502:mount.lustre.0 Request processed in 126us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185873.484248:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000020:01000004:3.0:1789185873.490863:0:17906:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789185873.490884:0:17906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff98f300183380) 00000020:00000080:3.0:1789185873.490942:0:17906:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789185873.491029:0:17906:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f1c316e800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789185873.491034:0:17906:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f1c316e800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789185873.491036:0:17906:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f1c316e800 3 00010000:00080000:3.0:1789185873.491065:0:17906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f2c7f9c000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.148@tcp at head 00010000:00010000:3.0:1789185873.497107:0:17906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789185873.497381:0:17906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789185873.497428:0:17906:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789185873.497441:0:17906:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xda5c730d5a74063 00000100:00080000:3.0:1789185873.497451:0:17906:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185873.497464:0:17906:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98f2c7f9c000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185873.497646:0:17906:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2c87b8a80 x1876096898489856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789185873.497690:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876096898489856:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789185873.497765:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185873.497810:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898489856 00000100:00100000:3.0:1789185873.497817:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898489856 00000100:00100000:3.0:1789185873.497850:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185873.497857:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876096898489856:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789185873.497887:0:17156:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:3.0:1789185873.498192:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xda5c730d5a7406a 00000004:00100000:3.0:1789185873.498208:0:17156:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789185873.498243:0:17156:0:(import.c:65:import_set_state_nolock()) ffff98f2c2af4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185873.498291:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876096898489856:12345-0@lo:38:llog_process_th.0 Request processed in 432us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.498300:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789185873.498348:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f2c87b8a80 x1876096898489856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185873.498360:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185873.498367:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789185873.498375:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789185873.498379:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789185873.498390:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c7f9c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789185873.498396:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876096898489856:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789185873.498422:0:17906:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789185873.498846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789185873.498851:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789185873.498856:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789185873.498859:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789185873.503392:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1789185873.503699:0:17887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789185873.503728:0:17887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789185873.503746:0:17887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0600/0xda5c730d5a7404e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74055 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185873.503760:0:17887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0600/0xda5c730d5a7404e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74055 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789185873.503818:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789185873.503820:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789185873.503821:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185873.503823:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185873.503824:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185873.503825:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185873.503826:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185873.503828:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185873.503829:0:17887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185873.503833:0:17887:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789185873.503835:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185873.503836:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789185873.503837:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185873.503838:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185873.503839:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185873.503840:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185873.503841:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185873.503842:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185873.503843:0:17887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185873.503871:0:17887:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789185873.503892:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789185873.507076:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185873.507117:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898489984 00000100:00100000:2.0:1789185873.507126:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898489984 00000100:00100000:2.0:1789185873.507176:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789185873.507186:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789185873.507232:0:17149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789185873.507246:0:17149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789185873.507413:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d339c0 going to sleep for 11 seconds 00000001:00100000:0.0:1789185873.509004:0:17135:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789185873.509594:0:17149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789185873.509609:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789185873.509990:0:17171:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789185873.509995:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789185873.510017:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.510035:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73f6e expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.510043:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74032 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.510052:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.510089:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a74032 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.510107:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a74032 expref: 18 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185873.510121:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898490112:0@lo:104: 00000100:00100000:3.0:1789185873.510178:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185873.510220:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a73f6e expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.510228:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a73f6e expref: 18 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185873.510253:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898490240:0@lo:104: 00000100:00100000:3.0:1789185873.510274:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185873.510290:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3138e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.510332:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898490112 00000100:00100000:3.0:1789185873.510337:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898490112 00000100:00100000:3.0:1789185873.510366:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898490240 00000100:00100000:3.0:1789185873.510368:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898490240 00000100:00100000:3.0:1789185873.510379:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185873.510386:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+4:17171:x1876096898490112:12345-0@lo:104: 00010000:00010000:3.0:1789185873.510397:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.510439:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185873.510445:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+4:17171:x1876096898490112:12345-0@lo:104: Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.510452:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185873.510467:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789185873.510632:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17887:x1876096898489984:12345-0@lo:253:mount.lustre.0 Request processed in 3447us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185873.510642:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789185873.510704:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17887:1876096898489984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789185873.510718:0:17887:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789185873.510722:0:17887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185873.510724:0:17887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789185873.510726:0:17887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185873.510727:0:17887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185873.510728:0:17887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185873.510729:0:17887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185873.510730:0:17887:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789185873.510732:0:17887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185873.510734:0:17887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789185873.510755:0:17887:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789185873.513012:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:17171:x1876096898490240:12345-0@lo:104: 00010000:00010000:3.0:1789185873.513047:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513157:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789185873.513167:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:17171:x1876096898490240:12345-0@lo:104: Request processed in 2692us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.513176:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185873.513243:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898490112:0@lo:104: 00000100:00100000:3.0:1789185873.513254:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898490240:0@lo:104: 00010000:00010000:3.0:1789185873.513286:0:17171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513307:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185873.513314:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513322:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185873.513327:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513336:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185873.513344:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185873.513351:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185873.513390:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513396:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185873.513417:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513424:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0030200/0xda5c730d5a74032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74039 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513437:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185873.513440:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513455:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031a00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185873.513459:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513466:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185873.513473:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185873.513490:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789185873.513504:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513510:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185873.513517:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513523:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a73f6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a73f75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513537:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185873.513539:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185873.513540:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185873.513547:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185873.513565:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898490368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185873.513606:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185873.513642:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185873.513648:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898490496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185873.513675:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185873.513715:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898490368 00000100:00100000:3.0:1789185873.513722:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898490368 00010000:00010000:3.0:1789185873.513745:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a74032 expref: 18 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185873.513766:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898490496 00000100:00100000:3.0:1789185873.513768:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898490496 00010000:00010000:3.0:1789185873.513778:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a73f6e expref: 19 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185873.513790:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185873.513797:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:3635:x1876096898490368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185873.513807:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185873.513812:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a74032 expref: 19 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513822:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a74032 expref: 19 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513836:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a74032 expref: 19 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.513847:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185873.513873:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3635:x1876096898490368:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.513879:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185873.513890:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185873.513896:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:3635:x1876096898490496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185873.517045:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185873.517062:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a73f6e expref: 17 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517081:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a73f6e expref: 17 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517099:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2ff9c1400/0xda5c730d5a73f75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a73f6e expref: 17 pid: 17150 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517112:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517121:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789185873.517138:0:17141:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007143200s 00010000:00010000:3.0:1789185873.517143:0:17141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517150:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517157:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517163:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517169:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185873.517173:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517190:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517209:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517220:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185873.517285:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+16:3635:x1876096898490496:12345-0@lo:103:ldlm_bl.0 Request processed in 3388us (3608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.517294:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185873.517368:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898490496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185873.517379:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898490368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185873.517405:0:17171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517413:0:17171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185873.517419:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166d600/0xda5c730d5a74071 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1789185873.525193:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789185873.525332:0:17912:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789185873.525336:0:17912:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789185873.525433:0:17913:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1789185873.525859:0:17913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789185873.526586:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789185873.528215:0:17914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1876096898490624:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789185873.528298:0:17914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.528327:0:17914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185873.528629:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898490624 00000100:00100000:3.0:1789185873.528639:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898490624 00000100:00100000:3.0:1789185873.528706:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185873.528715:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17914:x1876096898490624:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789185873.528816:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17914:x1876096898490624:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 102us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185873.528830:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789185873.529623:0:17914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1876096898490624:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789185873.529657:0:17914:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789185873.529692:0:17914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1876096898490752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789185873.529736:0:17914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.529764:0:17914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d126c0 going to sleep for 11 seconds 00000040:01000000:3.0:1789185873.529886:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789185873.530019:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789185873.530425:0:17887:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789185873.530433:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789185873.530471:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789185873.530611:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898490752 00000100:00100000:0.0:1789185873.530619:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898490752 00000100:00100000:0.0:1789185873.530668:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185873.530677:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17914:x1876096898490752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789185873.530810:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17914:x1876096898490752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185873.530817:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185873.530853:0:17914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1876096898490752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789185873.532035:0:17914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17914:1876096898490880:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789185873.532125:0:17914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.532148:0:17914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185873.533061:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898490880 00000100:00100000:1.0:1789185873.533069:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898490880 00000100:00100000:1.0:1789185873.533108:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185873.533116:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17914:x1876096898490880:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789185873.533177:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17914:x1876096898490880:12345-0@lo:900:lod0001_rec0000.0 Request processed in 62us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185873.533183:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789185873.533590:0:17914:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f2f758c380 x1876096898490880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789185889 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185873.533604:0:17914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17914:1876096898490880:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789185873.533661:0:17914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1876096898491008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789185873.533695:0:17914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185873.533723:0:17914:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e799a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789185873.534032:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898491008 00000100:00100000:1.0:1789185873.534037:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898491008 00000100:00100000:1.0:1789185873.534081:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185873.534087:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17914:x1876096898491008:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789185873.534145:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17914:x1876096898491008:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 58us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185873.534151:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789185873.534895:0:17914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17914:1876096898491008:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789185873.535440:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789185873.536111:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789185873.536168:0:17913:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789185873.536375:0:17914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185873.538080:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789185873.538147:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789185873.538333:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185873.539867:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789185873.539979:0:17914:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789185873.539985:0:17914:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:3.0:1789185873.540543:0:17887:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1789185873.542316:0:17887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789185873.558542:0:17887:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789185873.558582:0:17887:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb21ac1a17988 00100000:10000000:3.0:1789185873.558590:0:17887:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789185873.561869:0:17887:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789185873.561955:0:17887:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789185873.561977:0:17887:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789185873.562014:0:17887:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789185873.566517:0:17887:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185873.566765:0:17887:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789185873.830118:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:3.0:1789185874.344725:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185874.536524:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1789185874.789989:0:17153:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789185874.789998:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f1c316e800 from 8 10000000:01000000:3.0:1789185874.790004:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185874.790056:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185874.790067:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185874.790079:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185874.790105:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898491136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185874.790194:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185874.790258:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ab3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185874.790352:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898491136 00000100:00100000:0.0:1789185874.790360:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898491136 00000100:00100000:0.0:1789185874.790412:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789185874.790421:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+16:17153:x1876096898491136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185874.790434:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185874.790447:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a74078 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185874.790492:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a74078 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185874.790502:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74078 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185874.790510:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031400, rc 0) 00000100:00100000:0.0:1789185874.790568:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898491136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185874.790574:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789185874.790669:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898491136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185874.790685:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185874.790693:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185874.790747:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898491264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789185874.790778:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185874.790805:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e79a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185874.790859:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898491264 00000100:00100000:3.0:1789185874.790864:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898491264 00000100:00100000:3.0:1789185874.790900:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185874.790930:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898491264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789185874.790945:0:17147:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789185874.790962:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789185874.790965:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789185874.791046:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898491264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185874.791053:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789185874.791127:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898491264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789185874.791169:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789185874.791175:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185874.791184:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185874.791193:0:17153:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789185874.791195:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f1c41b6000 from 8 10000000:01000000:2.0:1789185874.791197:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789185874.791213:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185874.791220:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185874.791227:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185874.791239:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898491392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185874.791261:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185874.791290:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e79a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185874.791336:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898491392 00000100:00100000:3.0:1789185874.791340:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898491392 00000100:00100000:3.0:1789185874.791358:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789185874.791364:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898491392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185874.791372:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185874.791379:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a74086 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185874.791393:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a74086 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185874.791401:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74086 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185874.791408:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c166da00, rc 0) 00000100:00100000:3.0:1789185874.791441:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17153:x1876096898491392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185874.791465:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789185874.791533:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898491392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185874.791548:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185874.791555:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185874.791591:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898491520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789185874.791619:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185874.791640:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e79a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185874.791691:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898491520 00000100:00100000:3.0:1789185874.791695:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898491520 00000100:00100000:3.0:1789185874.791726:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789185874.791732:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17153:x1876096898491520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789185874.791742:0:17147:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789185874.791752:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789185874.791755:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789185874.791828:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17153:x1876096898491520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185874.791834:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789185874.791978:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898491520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789185874.792012:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789185874.792018:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185874.792025:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185874.854373:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:0.0:1789185875.368065:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789185875.562303:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789185875.883897:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:3.0:1789185876.400623:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185876.905159:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00010000:00010000:1.0:1789185877.414287:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185877.927105:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00000100:00100000:0.0:1789185878.438452:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185878.438486:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898491648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185878.438575:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789185878.440372:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185878.440423:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898491648 00000100:00100000:3.0:1789185878.440439:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898491648 00000100:00100000:3.0:1789185878.440532:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185878.440545:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898491648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185878.440602:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789185878.440733:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898491648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 190us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185878.440741:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185878.440814:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898491648:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789185878.952408:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789185878.952427:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789185878.952431:0:38:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185878.952455:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f1c36a0800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185878.952488:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2c87bb480 x1876096898491904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185878.952507:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185878.952511:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185878.952515:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185878.952518:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185878.952548:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185878.952553:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185878.952555:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185878.952558:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789185878.952598:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898492288:0@lo:400:kworker.0 00000100:00100000:3.0:1789185878.952687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185878.952758:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185878.952765:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898491776:0@lo:400:kworker.0 00000100:00100000:3.0:1789185878.952798:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185878.952832:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898491904:0@lo:38:kworker.0 00000100:00100000:3.0:1789185878.952863:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185878.952894:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898492032:0@lo:400:kworker.0 00000100:00100000:3.0:1789185878.952952:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185878.952979:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185878.952984:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898492160:0@lo:400:kworker.0 00000100:00100000:3.0:1789185878.953006:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185878.953040:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898492288 00000100:00100000:3.0:1789185878.953050:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898492288 00000100:00100000:3.0:1789185878.953099:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898492032 00000100:00100000:3.0:1789185878.953102:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898492032 00000100:00100000:3.0:1789185878.953118:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185878.953127:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898492288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185878.953185:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898492288:12345-0@lo:400:kworker.0 Request processed in 58us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185878.953192:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185878.953212:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185878.953217:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898492032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185878.953247:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898492032:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185878.953252:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185878.953270:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898491776 00000100:00100000:3.0:1789185878.953275:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898491776 00000100:00100000:3.0:1789185878.953302:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789185878.953308:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3637:x1876096898491776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185878.953337:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3637:x1876096898491776:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185878.953343:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789185878.953387:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898491904 00000100:00100000:3.0:1789185878.953391:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898491904 00000100:00100000:3.0:1789185878.953411:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898492160 00000100:00100000:3.0:1789185878.953413:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898492160 00000100:00100000:3.0:1789185878.953437:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185878.953442:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876096898491904:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789185878.953471:0:17160:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:3.0:1789185878.953518:0:17160:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a74094 00000004:00100000:3.0:1789185878.953538:0:17160:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789185878.953546:0:17160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789185878.953662:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185878.953670:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898492160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185878.953706:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898492160:12345-0@lo:400:kworker.0 Request processed in 36us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185878.953712:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185878.953756:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898492160:0@lo:400:kworker.0 00010000:00080000:3.0:1789185878.953772:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f2c87b8380 x1876096898492032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185878.953783:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898492032:0@lo:400:kworker.0 00000100:00100000:3.0:1789185878.953814:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898491776:0@lo:400:kworker.0 00010000:00080000:3.0:1789185878.953824:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f2c87b8700 x1876096898492288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185878.953833:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898492288:0@lo:400:kworker.0 00000100:00100000:1.0:1789185878.954255:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 0 seconds 00000100:00080000:3.0:1789185878.969072:0:17160:0:(import.c:65:import_set_state_nolock()) ffff98f2d816f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185878.969221:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1876096898491904:12345-0@lo:38:kworker.0 Request processed in 15774us (16354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185878.969235:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789185878.969552:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789185878.969568:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789185878.969575:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789185878.969578:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c36a0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789185878.969607:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008377af77): req@ffff98f1c19b3b80 x1876096898484480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185878.969630:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898491904:0@lo:38:kworker.0 00000100:00100000:1.0:1789185878.969737:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185878.969768:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185878.970070:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898484480 00000100:00100000:3.0:1789185878.970081:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898484480 00000100:00100000:3.0:1789185878.970140:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185878.970152:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17197:x1876096898484480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789185878.970266:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17197:x1876096898484480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 117us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185878.970274:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185878.970326:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1876096898484480:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789185878.970386:0:17197:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789185878.970432:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1876096898492544:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789185878.970474:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185878.970513:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6161a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185878.970540:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898492544 00000100:00100000:1.0:1789185878.970542:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898492416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185878.970546:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898492544 00000100:00100000:3.0:1789185878.970583:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185878.970592:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17197:x1876096898492544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789185878.970606:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185878.974060:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17197:x1876096898492544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 3455us (3569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185878.974082:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185878.974123:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898492416 00000100:00100000:3.0:1789185878.974132:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898492416 00000100:00100000:3.0:1789185878.974167:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789185878.974176:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898492416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185878.974218:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789185878.974287:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1876096898492544:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789185878.974289:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898492416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (3682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185878.974329:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789185878.974411:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898492416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185878.974464:0:17197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1876096898492672:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789185878.974531:0:17197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185878.974571:0:17197:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c7f15180 going to sleep for 11 seconds 00000100:00100000:2.0:1789185878.975618:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898492672 00000100:00100000:2.0:1789185878.975630:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898492672 00000100:00100000:2.0:1789185878.975673:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789185878.975683:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17197:x1876096898492672:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789185878.975801:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17197:x1876096898492672:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 120us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185878.975808:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185878.977705:0:17197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17197:1876096898492672:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789185878.977790:0:17197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185878.983281:0:17197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789185878.987545:0:17197:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:1.0:1789185878.987557:0:17197:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789185879.470189:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789185879.584590:0:18157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789185879.920439:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789185880.486553:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789185880.690848:0:18210:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185880.691623:0:18210:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789185881.511032:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789185881.771046:0:18261:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185881.771886:0:18261:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789185882.027163:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185867/real 1789185867] req@ffff98f2f758e300 x1876096898485504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185882 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185882.027207:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f2f758e300 x1876096898485504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185882 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185882.027219:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185867/real 1789185867] req@ffff98f2f758ce00 x1876096898485632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185882 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185882.027232:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f2f758ce00 x1876096898485632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185882 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789185882.027259:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f30104b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789185882.027283:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789185882.027288:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898485504:0@lo:8:kworker.0 00000100:00080000:2.0:1789185882.027295:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789185882.027300:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789185882.027304:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898485632:0@lo:8:kworker.0 00000100:00080000:0.0:1789185882.027509:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185882.027516:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789185882.027531:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f30104b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185882.027537:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:0.0:1789185882.027544:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789185882.027557:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f30104b800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185882.027582:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758e300 x1876096898493056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185882.027595:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185882.027615:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789185882.027618:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185882.027621:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:0.0:1789185882.027624:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789185882.027630:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f2f2752000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185882.027641:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758c380 x1876096898493184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185882.027672:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185882.027676:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185882.027679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185882.027683:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789185882.027812:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898492800:0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.027933:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185882.027994:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898493568:0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.028027:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185882.028054:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185882.028061:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898492928:0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.028087:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185882.028117:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898493312:0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.028141:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185882.028160:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185882.028166:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898493440:0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.028188:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185882.028223:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898493568 00000100:00100000:3.0:1789185882.028233:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898493568 00000100:00100000:3.0:1789185882.028285:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898493312 00000100:00100000:3.0:1789185882.028289:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898493312 00000100:00100000:3.0:1789185882.028307:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185882.028330:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898493568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.028392:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898493568:12345-0@lo:400:kworker.0 Request processed in 64us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185882.028399:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185882.028439:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789185882.028447:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898493312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.028483:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898493312:12345-0@lo:400:kworker.0 Request processed in 38us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185882.028489:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789185882.028508:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898492928 00000100:00100000:3.0:1789185882.028511:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898492928 00000100:00100000:3.0:1789185882.028536:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898493440 00000100:00100000:3.0:1789185882.028539:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898493440 00000100:00100000:3.0:1789185882.028555:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185882.028561:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898492928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.028595:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898492928:12345-0@lo:400:kworker.0 Request processed in 35us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185882.028602:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185882.028613:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185882.028619:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898493440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.028644:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898493440:12345-0@lo:400:kworker.0 Request processed in 25us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185882.028650:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185882.028696:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898493440:0@lo:400:kworker.0 00010000:00080000:3.0:1789185882.028708:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f2f758e680 x1876096898493312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185882.028718:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898493312:0@lo:400:kworker.0 00000100:00100000:3.0:1789185882.028747:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898492928:0@lo:400:kworker.0 00010000:00080000:3.0:1789185882.028757:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f2f758d180 x1876096898493568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185882.028772:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898493568:0@lo:400:kworker.0 00000100:00100000:2.0:1789185882.029577:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898493056:0@lo:8:kworker.0 00000400:00000100:2.0:1789185882.029627:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898493056 offset 0 length 520: 4 00000100:00100000:2.0:1789185882.029662:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898493184:0@lo:8:kworker.0 00000400:00000100:2.0:1789185882.029679:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898493184 offset 0 length 520: 4 00000100:00100000:0.0:1789185882.029858:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898492800 00000100:00100000:0.0:1789185882.029866:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898492800 00000100:00100000:0.0:1789185882.029943:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789185882.029954:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3635:x1876096898492800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185882.030030:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3635:x1876096898492800:12345-0@lo:400:kworker.0 Request processed in 78us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185882.030039:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789185882.031184:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898492800:0@lo:400:kworker.0 00010000:00010000:1.0:1789185882.534092:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185883.057383:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185873/real 1789185873] req@ffff98f1c34b1500 x1876096898488064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185883 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185883.057422:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f1c34b1500 x1876096898488064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185883 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185883.057498:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185873/real 1789185873] req@ffff98f2f758ca80 x1876096898487808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185883 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185883.057516:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f2f758ca80 x1876096898487808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185883 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789185883.057541:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789185883.057606:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789185883.057611:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898488064:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789185883.057618:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c3526000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1789185883.057728:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898493696:0@lo:400:kworker.0 00000100:00100000:2.0:1789185883.057822:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185883.057961:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898493696 00000100:00100000:3.0:1789185883.057973:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898493696 00000100:00100000:3.0:1789185883.058054:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789185883.058065:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3636:x1876096898493696:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789185883.058195:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185883.058210:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185883.058213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185883.058217:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789185883.058419:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789185883.058425:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898487808:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789185883.064822:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3636:x1876096898493696:12345-0@lo:400:kworker.0 Request processed in 6743us (6984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185883.064857:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789185883.064968:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898493824:0@lo:400:kworker.0 00000100:00100000:3.0:1789185883.065057:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185883.065104:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185883.065112:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898493952:0@lo:400:kworker.0 00000100:00100000:3.0:1789185883.065138:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185883.065181:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898493824 00000100:00100000:3.0:1789185883.065193:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898493824 00000100:00100000:3.0:1789185883.065247:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185883.065259:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898493824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185883.065449:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876096898493824:12345-0@lo:400:kworker.0 Request processed in 192us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185883.065456:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185883.065476:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898493952 00000100:00100000:3.0:1789185883.065479:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898493952 00000100:00100000:3.0:1789185883.065510:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185883.065517:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898493952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185883.065548:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898493952:12345-0@lo:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185883.065568:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789185883.065620:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f2f758c000 x1876096898493952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185883.065637:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898493952:0@lo:400:kworker.0 00000100:00100000:3.0:1789185883.065647:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898493824:0@lo:400:kworker.0 00000100:00100000:3.0:1789185883.066086:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898494080:0@lo:400:kworker.0 00000100:00100000:3.0:1789185883.066126:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185883.066290:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898493696:0@lo:400:kworker.0 00000100:00100000:2.0:1789185883.066394:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898494080 00000100:00100000:2.0:1789185883.066400:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898494080 00000100:00100000:2.0:1789185883.066442:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789185883.066450:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898494080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185883.066497:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898494080:12345-0@lo:400:kworker.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185883.066504:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789185883.066596:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185883.066603:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789185883.066607:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f1c3526000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185883.066614:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1789185883.066620:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185883.066630:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f1c3526000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185883.066666:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758ce00 x1876096898494208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185883.066691:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185883.066695:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789185883.066697:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185883.066700:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1789185883.066703:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789185883.066708:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f2c7c41800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185883.066722:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758e680 x1876096898494336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185883.066752:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185883.066756:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185883.066759:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185883.066762:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789185883.066965:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898494208:0@lo:8:kworker.0 00000400:00000100:0.0:1789185883.067005:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898494208 offset 0 length 520: 4 00000100:00100000:2.0:1789185883.067130:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898494464:0@lo:400:kworker.0 00000100:00100000:2.0:1789185883.067167:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185883.067196:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898494464 00000100:00100000:2.0:1789185883.067202:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898494464 00000100:00100000:2.0:1789185883.067234:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789185883.067241:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898494464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185883.067279:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898494464:12345-0@lo:400:kworker.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185883.067286:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789185883.067392:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f2f758df80 x1876096898494464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185883.067404:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898494464:0@lo:400:kworker.0 00000100:00100000:3.0:1789185883.067499:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898494080:0@lo:400:kworker.0 00000100:00100000:0.0:1789185883.067567:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898494336:0@lo:8:kworker.0 00000400:00000100:0.0:1789185883.067592:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876096898494336 offset 0 length 520: 4 00000020:00000080:1.0:1789185883.084160:0:18309:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff315b6ab0 20000000:00000080:1.0:1789185883.084187:0:18309:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f2fb2c3c00 uarg=0000000000000000 20000000:01000000:1.0:1789185883.084248:0:18309:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789185883.084259:0:18309:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789185883.084266:0:18309:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789185883.084874:0:18310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789185883.085403:0:18309:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789185883.111071:0:18309:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789185883.111159:0:18309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185883.111204:0:18309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a73f3d expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185883.111212:0:18309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74040 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185883.111221:0:18309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185883.111284:0:18309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a74040 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185883.111317:0:18309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a74040 expref: 17 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185883.111335:0:18309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18309:1876096898494592:0@lo:104: 00000100:00100000:0.0:1789185883.111612:0:18309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185883.111678:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898494592 00000100:00100000:3.0:1789185883.111690:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898494592 00010000:00010000:0.0:1789185883.111697:0:18309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a73f3d expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185883.111709:0:18309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a73f3d expref: 17 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185883.111744:0:18309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18309:1876096898494720:0@lo:104: 00000100:00100000:0.0:1789185883.111774:0:18309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185883.111781:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789185883.111786:0:18309:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7424780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185883.111797:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:18309:x1876096898494592:12345-0@lo:104: 00010000:00010000:3.0:1789185883.111814:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.111892:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185883.111898:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:18309:x1876096898494592:12345-0@lo:104: Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185883.111931:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185883.111952:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898494720 00000100:00100000:3.0:1789185883.111955:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898494720 00000100:00100000:3.0:1789185883.111969:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185883.111974:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:18309:x1876096898494720:12345-0@lo:104: 00010000:00010000:3.0:1789185883.111982:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112026:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789185883.112031:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:18309:x1876096898494720:12345-0@lo:104: Request processed in 56us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185883.112038:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789185883.112062:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185883.112070:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112079:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185883.112084:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112094:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185883.112102:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185883.112109:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185883.112144:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112151:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185883.112179:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112186:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0030800/0xda5c730d5a74040 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74047 expref: -99 pid: 17887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112213:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185883.112217:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112222:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185883.112225:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112232:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185883.112238:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185883.112243:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185883.112257:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112274:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185883.112282:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112290:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166c800/0xda5c730d5a73f3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a73f44 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112321:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185883.112323:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185883.112324:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185883.112348:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898494848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185883.112389:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185883.112436:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185883.112443:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898494976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185883.112463:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185883.112497:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898494848 00000100:00100000:3.0:1789185883.112501:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898494848 00010000:00010000:3.0:1789185883.112521:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a74040 expref: 18 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185883.112540:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898494976 00000100:00100000:3.0:1789185883.112543:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898494976 00010000:00010000:3.0:1789185883.112555:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a73f3d expref: 19 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185883.112568:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185883.112574:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:3637:x1876096898494848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185883.112586:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185883.112592:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a74040 expref: 19 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112604:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a74040 expref: 19 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112634:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185883.112663:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:3637:x1876096898494848:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185883.112670:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185883.112690:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185883.112697:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3637:x1876096898494976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185883.112713:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185883.112718:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a73f3d expref: 18 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112727:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a73f3d expref: 18 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112739:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112749:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112765:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112774:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112781:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112788:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112794:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030200 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185883.112798:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112805:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112825:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185883.112836:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185883.112858:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3637:x1876096898494976:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185883.112865:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185883.112936:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898494976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185883.112948:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898494848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789185883.113150:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185883.113793:0:18309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c402f600/0xda5c730d5a74047 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a74040 expref: 17 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185883.113814:0:18309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18309:1876096898494592:0@lo:104: 00010000:00010000:0.0:1789185883.113827:0:18309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c402f000/0xda5c730d5a73f44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a73f3d expref: 16 pid: 17149 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185883.113835:0:18309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18309:1876096898494720:0@lo:104: 00010000:00010000:0.0:1789185883.113858:0:18309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185883.113870:0:18309:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185883.113876:0:18309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185883.113882:0:18309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0030200/0xda5c730d5a7409b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185883.561429:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185883.561459:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898495104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185883.561562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185883.565550:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898495104 00000100:00100000:3.0:1789185883.565583:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898495104 00000100:00100000:3.0:1789185883.565729:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185883.565744:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898495104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185883.565809:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789185883.565969:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898495104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (4407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185883.565978:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789185883.566073:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898495104:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789185883.568103:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185884.070163:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185884.070194:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898495232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185884.070304:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185884.070796:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898495232 00000100:00100000:3.0:1789185884.070809:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898495232 00000100:00100000:3.0:1789185884.070885:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789185884.070897:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898495232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185884.070985:0:17896:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789185884.071053:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898495232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185884.071069:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789185884.071190:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898495232:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185884.585201:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789185884.589810:0:17888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:2.0:1789185885.094113:0:17153:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185885.094121:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f1c316e800 from 13 10000000:01000000:2.0:1789185885.094134:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185885.094179:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185885.094192:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185885.094204:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185885.094232:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185885.094431:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185885.094477:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ab6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185885.094536:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898495360 00000100:00100000:3.0:1789185885.094545:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898495360 00000100:00100000:3.0:1789185885.094601:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789185885.094612:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+16:17153:x1876096898495360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185885.094625:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185885.094638:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a740a2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185885.094660:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a740a2 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185885.094671:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a740a2 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185885.094680:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c13a3c00, rc 0) 00000100:00100000:3.0:1789185885.094724:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898495360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185885.094731:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789185885.094894:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185885.095038:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185885.095060:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185885.095124:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185885.095153:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185885.095173:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c71d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185885.095221:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898495488 00000100:00100000:2.0:1789185885.095226:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898495488 00000100:00100000:3.0:1789185885.095344:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789185885.095354:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898495488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185885.095480:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898495488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185885.095488:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789185885.095867:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185885.095899:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185885.096052:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185885.096074:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c71d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789185885.096152:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898495616 00000100:00100000:2.0:1789185885.096158:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898495616 00000100:00100000:2.0:1789185885.096191:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789185885.096198:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898495616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185885.096364:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898495616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185885.096371:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789185885.096473:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789185885.101474:0:18386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789185885.101754:0:17153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789185885.101790:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789185885.101802:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185885.101813:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185885.101823:0:17153:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789185885.101840:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f1c41b6000 from 13 10000000:01000000:0.0:1789185885.101843:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185885.101883:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185885.101891:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185885.101903:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185885.101953:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185885.102021:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185885.102058:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7424000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185885.102603:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898495744 00000100:00100000:2.0:1789185885.102611:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898495744 00000100:00100000:2.0:1789185885.102658:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789185885.102667:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+17:17153:x1876096898495744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185885.102680:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185885.102694:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a740b0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185885.102732:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a740b0 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185885.102742:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a740b0 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185885.102750:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402fe00, rc 0) 00000100:00100000:2.0:1789185885.102795:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17153:x1876096898495744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185885.102802:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789185885.102850:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185885.102864:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185885.102874:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185885.103220:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185885.103250:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185885.103346:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ab6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185885.103362:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898495872 00000100:00100000:2.0:1789185885.103366:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898495872 00000100:00100000:2.0:1789185885.103390:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789185885.103397:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17153:x1876096898495872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185885.103512:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17153:x1876096898495872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185885.103535:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789185885.103571:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898495872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789185885.103599:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898496000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185885.103636:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185885.103649:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ab6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789185885.103659:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898496000 00000100:00100000:2.0:1789185885.103663:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898496000 00000100:00100000:2.0:1789185885.103683:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789185885.103689:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17153:x1876096898496000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185885.103764:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:17153:x1876096898496000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185885.103771:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789185885.103811:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898496000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789185885.107473:0:18387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789185885.107675:0:17153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789185885.107697:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185885.107709:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185885.107722:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185885.617975:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185885.801228:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789185886.630224:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185887.657307:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789185888.167364:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185888.167372:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185888.167375:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185888.167378:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185888.167408:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185888.167411:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185888.167422:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185888.167425:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789185888.167460:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898496384:0@lo:400:kworker.0 00000100:00100000:0.0:1789185888.167528:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185888.167569:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185888.167575:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898496512:0@lo:400:kworker.0 00000100:00100000:0.0:1789185888.167600:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185888.167687:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898496128:0@lo:400:kworker.0 00000100:00100000:3.0:1789185888.167723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185888.167762:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898496640:0@lo:400:kworker.0 00000100:00100000:3.0:1789185888.167783:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185888.167802:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185888.167808:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898496256:0@lo:400:kworker.0 00000100:00100000:3.0:1789185888.167829:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185888.167860:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898496384 00000100:00100000:3.0:1789185888.167867:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898496384 00000100:00100000:3.0:1789185888.167929:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898496640 00000100:00100000:3.0:1789185888.167932:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898496640 00000100:00100000:3.0:1789185888.167948:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185888.167955:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898496384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185888.168009:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898496384:12345-0@lo:400:kworker.0 Request processed in 53us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185888.168016:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185888.168032:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185888.168038:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898496640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185888.168067:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898496640:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185888.168072:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185888.168091:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898496512 00000100:00100000:3.0:1789185888.168095:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898496512 00000100:00100000:3.0:1789185888.168114:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898496256 00000100:00100000:3.0:1789185888.168117:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898496256 00000100:00100000:3.0:1789185888.168127:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789185888.168138:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898496512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185888.168167:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898496512:12345-0@lo:400:kworker.0 Request processed in 30us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185888.168173:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789185888.168183:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789185888.168188:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898496256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185888.168225:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898496256:12345-0@lo:400:kworker.0 Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185888.168230:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789185888.168267:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898496512:0@lo:400:kworker.0 00010000:00080000:3.0:1789185888.168279:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f2f758d180 x1876096898496384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185888.168289:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898496384:0@lo:400:kworker.0 00000100:00100000:3.0:1789185888.168320:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898496256:0@lo:400:kworker.0 00010000:00080000:3.0:1789185888.168328:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c3484e00 x1876096898496640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185888.168337:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898496640:0@lo:400:kworker.0 00000100:00100000:0.0:1789185888.168523:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898496128 00000100:00100000:0.0:1789185888.168528:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898496128 00000100:00100000:0.0:1789185888.168565:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789185888.168573:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3637:x1876096898496128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185888.168618:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:3637:x1876096898496128:12345-0@lo:400:kworker.0 Request processed in 47us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185888.168625:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789185888.169084:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898496128:0@lo:400:kworker.0 00000100:00100000:0.0:1789185888.678105:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898496768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185888.678198:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789185888.678363:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185888.678389:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898496768 00000100:00100000:1.0:1789185888.678398:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898496768 00000100:00100000:1.0:1789185888.678446:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789185888.678454:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898496768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789185888.678489:0:17896:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789185888.682695:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898496768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4233us (4498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185888.682710:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789185888.686140:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898496768:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789185889.129671:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789185889.190367:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185889.190389:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898496896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185889.190456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185889.190498:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898496896 00000100:00100000:3.0:1789185889.190515:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898496896 00000100:00100000:3.0:1789185889.190557:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185889.190566:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898496896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789185889.190598:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789185889.190640:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898496896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185889.190648:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185889.190704:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898496896:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789185889.704453:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789185889.972325:0:18657:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789185889.972330:0:18657:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789185889.972332:0:18657:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789185889.972442:0:18657:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98f2e65a0800 00000020:01000004:2.0:1789185889.972458:0:18657:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789185889.972474:0:18657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789185889.972494:0:18657:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98f2c6fd3380) 00000020:00000080:2.0:1789185889.972511:0:18657:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789185890.078502:0:18657:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789185890.085512:0:18657:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789185890.086142:0:18657:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789185890.086388:0:18657:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789185890.086723:0:18657:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789185890.086970:0:18657:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789185890.087267:0:18657:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1789185890.097171:0:18657:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789185890.097393:0:18657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789185890.097409:0:18657:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789185890.097429:0:18657:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xda5c730d5a740c5 00000020:01000004:1.0:1789185890.097437:0:18657:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789185890.097458:0:18657:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789185890.097461:0:18657:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789185890.097467:0:18657:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789185890.097472:0:18657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789185890.097493:0:18657:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98f30038b380) 00000020:00000080:1.0:1789185890.097505:0:18657:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789185890.103337:0:18657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789185890.104456:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789185890.104467:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789185890.114044:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789185890.114064:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789185890.114808:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789185890.114816:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789185890.121692:0:18657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789185890.121905:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789185890.121938:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789185890.124120:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789185890.124134:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789185890.172075:0:18657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789185890.172553:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789185890.172560:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789185890.174681:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789185890.174696:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789185890.175845:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789185890.175858:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789185890.184531:0:18657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789185890.185057:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789185890.185066:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789185890.188039:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789185890.188052:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789185890.252716:0:18657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789185890.252986:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789185890.252997:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789185890.256387:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789185890.256406:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789185890.258033:0:18657:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789185890.258065:0:18657:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789185890.258072:0:18657:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789185890.274756:0:18657:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789185890.274811:0:18657:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.148@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789185890.274816:0:18657:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789185890.274818:0:18657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185890.274819:0:18657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185890.274820:0:18657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185890.274822:0:18657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185890.274823:0:18657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185890.274824:0:18657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185890.274826:0:18657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185890.274827:0:18657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185890.274831:0:18657:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789185890.274833:0:18657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185890.274834:0:18657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185890.274835:0:18657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185890.274836:0:18657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185890.274837:0:18657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185890.274837:0:18657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185890.274839:0:18657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185890.274840:0:18657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185890.274840:0:18657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789185890.274867:0:18657:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789185890.274888:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497024:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789185890.275073:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185890.275193:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d8251900 going to sleep for 11 seconds 00000100:00100000:0.0:1789185890.275715:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898497024 00000100:00100000:0.0:1789185890.275725:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898497024 00000100:00100000:0.0:1789185890.275817:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789185890.275827:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:18657:x1876096898497024:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789185890.275859:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789185890.275862:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789185890.275866:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789185890.276240:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:18657:x1876096898497024:12345-0@lo:253:mount.lustre.0 Request processed in 414us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.276249:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789185890.276337:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497024:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789185890.276349:0:18657:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789185890.276352:0:18657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789185890.276353:0:18657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789185890.276354:0:18657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789185890.276355:0:18657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789185890.276356:0:18657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789185890.276358:0:18657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789185890.276359:0:18657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789185890.276361:0:18657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789185890.276362:0:18657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789185890.276393:0:18657:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f2e65a0800 from lustre-OST0000 10000000:01000000:3.0:1789185890.276447:0:18657:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789185890.276451:0:18657:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789185890.276459:0:18657:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f1c2073380 local copy 00010000:00010000:3.0:1789185890.276481:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185890.276588:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185890.276632:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.277186:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185890.277324:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898497152 00000100:00100000:2.0:1789185890.277330:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898497152 00000100:00100000:2.0:1789185890.277387:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789185890.277396:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:18657:x1876096898497152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185890.277637:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:18657:x1876096898497152:12345-0@lo:501:mount.lustre.0 Request processed in 242us (1003us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185890.277645:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789185890.277725:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497152:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789185890.277743:0:18657:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789185890.277765:0:18657:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789185890.277773:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185890.277784:0:18657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185890.277809:0:18657:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f2e65a0800 10000000:01000000:3.0:1789185890.277813:0:18657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789185890.277819:0:18657:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789185890.277821:0:18657:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185890.277825:0:18657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789185890.277828:0:18657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789185890.277854:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3200/0xda5c730d5a740d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185890.277862:0:18657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3200/0xda5c730d5a740d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185890.277871:0:18657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3200/0xda5c730d5a740d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185890.277886:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789185890.277943:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.277969:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185890.278070:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898497280 00000100:00100000:2.0:1789185890.278076:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898497280 00000100:00100000:2.0:1789185890.278096:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789185890.278102:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+18:18657:x1876096898497280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789185890.278111:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185890.278124:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402f600/0xda5c730d5a740da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a740d3 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185890.278147:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402f600/0xda5c730d5a740da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a740d3 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185890.278226:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402f600/0xda5c730d5a740da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a740d3 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185890.278237:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f600, rc 0) 00000100:00100000:2.0:1789185890.278269:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497280:12345-0@lo:101:mount.lustre.0 Request processed in 168us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185890.278276:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789185890.278350:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185890.278363:0:18657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3200/0xda5c730d5a740d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740da expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185890.278373:0:18657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3200/0xda5c730d5a740d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a740da expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185890.279817:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789185890.280795:0:18657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185890.284424:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789185890.284481:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789185890.284497:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789185890.284509:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789185890.284654:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789185890.284671:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789185890.284696:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789185890.284702:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789185890.284805:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185890.284868:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185890.285001:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898497408 00000100:00100000:2.0:1789185890.285009:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898497408 00000100:00100000:2.0:1789185890.285059:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789185890.285078:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185890.285235:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497408:12345-0@lo:501:mount.lustre.0 Request processed in 159us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185890.285243:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789185890.286006:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185890.286037:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185890.286078:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185890.286134:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.286264:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185890.286298:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898497536 00000100:00100000:2.0:1789185890.286304:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898497536 00000100:00100000:2.0:1789185890.286384:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789185890.286392:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185890.287285:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497536:12345-0@lo:503:mount.lustre.0 Request processed in 888us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185890.287297:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789185890.287406:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789185890.287852:0:18657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789185890.287943:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185890.288000:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.293098:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185890.296361:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898497664 00000100:00100000:0.0:1789185890.296388:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898497664 00000100:00100000:0.0:1789185890.296820:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789185890.296831:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185890.297448:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497664:12345-0@lo:502:mount.lustre.0 Request processed in 618us (9446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.297458:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789185890.297887:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185890.298124:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789185890.298270:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789185890.298293:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789185890.298306:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789185890.298317:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789185890.298327:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789185890.298338:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789185890.298352:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789185890.298620:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789185890.298642:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789185890.298658:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789185890.298671:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789185890.298709:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185890.298768:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.298862:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185890.299034:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898497792 00000100:00100000:2.0:1789185890.299042:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898497792 00000100:00100000:0.0:1789185890.299277:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789185890.299341:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185890.299467:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497792:12345-0@lo:502:mount.lustre.0 Request processed in 181us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185890.299485:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789185890.299701:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789185890.299768:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789185890.299779:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789185890.300655:0:18674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789185890.300664:0:18674:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789185890.300684:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789185890.300687:0:18674:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789185890.300693:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789185890.300710:0:18674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98f3001819c0) 00000020:00000080:3.0:1789185890.300737:0:18674:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789185890.300744:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789185890.300834:0:18674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f2e65a0800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789185890.300842:0:18674:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789185890.300849:0:18674:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xda5c730d5a740e8 00010000:00010000:3.0:1789185890.312506:0:18674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789185890.313330:0:18674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1789185890.318431:0:18674:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789185890.323727:0:18674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789185890.323741:0:18674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185890.323748:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.323750:0:18674:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789185890.323754:0:18674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789185890.323757:0:18674:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789185890.323759:0:18674:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789185890.323760:0:18674:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789185890.323762:0:18674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789185890.323764:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.323765:0:18674:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789185890.323768:0:18674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185890.323778:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.323780:0:18674:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789185890.323784:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789185890.323786:0:18674:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789185890.323788:0:18674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185890.323790:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.323792:0:18674:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789185890.323794:0:18674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185890.323796:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.323797:0:18674:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789185890.323800:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789185890.323832:0:18674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185890.323835:0:18674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.323837:0:18674:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789185890.323840:0:18674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789185890.327623:0:18657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789185890.327677:0:18657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789185890.327706:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3200/0xda5c730d5a740d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740da expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185890.327720:0:18657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3200/0xda5c730d5a740d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740da expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185890.327728:0:18657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2e65a0800 from 1 10000000:01000000:1.0:1789185890.327731:0:18657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789185890.327774:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185890.327782:0:18657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185890.327793:0:18657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185890.327841:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789185890.327929:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185890.332646:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898497920 00000100:00100000:0.0:1789185890.332663:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898497920 00000100:00100000:0.0:1789185890.332883:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789185890.332893:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898497920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185890.332927:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185890.332945:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a740ef expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.332975:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a740ef expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.332987:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a740ef expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.332996:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031200, rc 0) 00000100:00100000:0.0:1789185890.333068:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898497920:12345-0@lo:101:mount.lustre.0 Request processed in 177us (5138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.333075:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789185890.335751:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce2d60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185890.335797:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898497920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185890.335825:0:18657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185890.335838:0:18657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789185890.344198:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789185890.344493:0:18657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185890.347357:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789185890.347637:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789185890.347664:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789185890.347670:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789185890.347779:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185890.347850:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185890.347899:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185890.347951:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898498048 00000100:00100000:2.0:1789185890.347959:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898498048 00000100:00100000:2.0:1789185890.348008:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789185890.348019:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898498048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185890.348166:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898498048:12345-0@lo:501:mount.lustre.0 Request processed in 139us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185890.348176:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789185890.349291:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185890.349338:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185890.349479:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185890.349570:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185890.349678:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898498176 00000100:00100000:2.0:1789185890.349684:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898498176 00000100:00100000:2.0:1789185890.349724:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789185890.349732:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898498176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185890.350190:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898498176:12345-0@lo:503:mount.lustre.0 Request processed in 456us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185890.350207:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789185890.350333:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498176:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789185890.350899:0:18657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789185890.351238:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185890.351285:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185890.351315:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789185890.353457:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898498304 00000100:00100000:0.0:1789185890.353473:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898498304 00000100:00100000:0.0:1789185890.353864:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789185890.353874:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898498304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185890.354061:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898498304:12345-0@lo:502:mount.lustre.0 Request processed in 188us (2774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.354069:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789185890.354101:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185890.354357:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789185890.354390:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789185890.354405:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789185890.354420:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789185890.354434:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789185890.354448:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789185890.354461:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789185890.354490:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789185890.354505:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789185890.354599:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789185890.354635:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789185890.354671:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185890.354734:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185890.358381:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d78fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185890.358413:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898498432 00000100:00100000:2.0:1789185890.358424:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898498432 00000100:00100000:3.0:1789185890.358728:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789185890.358739:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898498432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185890.359143:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898498432:12345-0@lo:502:mount.lustre.0 Request processed in 406us (4409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185890.359151:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789185890.359251:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185890.359334:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789185890.359348:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789185890.360331:0:18678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185890.360347:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.360356:0:18678:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789185890.360363:0:18678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f2e65a0800 00000020:00000080:1.0:1789185890.360365:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185890.360372:0:18678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185890.360374:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.360376:0:18678:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789185890.360386:0:18678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185890.360388:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.360389:0:18678:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789185890.360392:0:18678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f2e65a0800 00000020:00000080:1.0:1789185890.360394:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185890.360481:0:18678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185890.360485:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.360486:0:18678:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789185890.360489:0:18678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185890.360491:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.360492:0:18678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789185890.360496:0:18678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f2e65a0800 00000020:00000080:1.0:1789185890.360498:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185890.365023:0:18678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185890.365052:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.365054:0:18678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789185890.365058:0:18678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185890.365061:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.365063:0:18678:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789185890.365067:0:18678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f2e65a0800 00000020:00000080:1.0:1789185890.365069:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789185890.365129:0:18678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185890.365132:0:18678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185890.365133:0:18678:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789185890.365136:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789185890.365845:0:18657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789185890.365883:0:18657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185890.365927:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185890.365940:0:18657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185890.365994:0:18657:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789185890.365997:0:18657:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f2e65a0800 10000000:01000000:3.0:1789185890.366000:0:18657:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f2e65a0800 10000000:01000000:3.0:1789185890.366004:0:18657:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789185890.366009:0:18657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f2e65a0800 from 1 10000000:01000000:3.0:1789185890.366012:0:18657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789185890.366050:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a740fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185890.366070:0:18657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a740fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185890.366083:0:18657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a740fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185890.366107:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789185890.366190:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.366237:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185890.366304:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898498560 00000100:00100000:1.0:1789185890.366312:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898498560 00000100:00100000:1.0:1789185890.366362:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789185890.366372:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:18657:x1876096898498560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185890.366395:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185890.366409:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2ff9c1000/0xda5c730d5a74104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a740fd expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185890.366445:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2ff9c1000/0xda5c730d5a74104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a740fd expref: 21 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185890.366455:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2ff9c1000/0xda5c730d5a74104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a740fd expref: 21 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185890.366464:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1000, rc 0) 00000100:00100000:1.0:1789185890.366529:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898498560:12345-0@lo:101:mount.lustre.0 Request processed in 158us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185890.366536:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789185890.366758:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185890.366772:0:18657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a740fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74104 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185890.366780:0:18657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a740fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74104 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789185890.369209:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789185890.369681:0:18657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789185890.369889:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789185890.369940:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789185890.369958:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789185890.369974:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789185890.369988:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789185890.370003:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789185890.370016:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789185890.370030:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789185890.370043:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789185890.370056:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789185890.370069:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789185890.370095:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789185890.370110:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789185890.370123:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789185890.370137:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789185890.370151:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789185890.371207:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789185890.371230:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789185890.371244:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789185890.371259:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789185890.371271:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789185890.371283:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789185890.371295:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789185890.371309:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789185890.371322:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789185890.371334:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789185890.371347:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789185890.371360:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789185890.371373:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789185890.371386:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789185890.371400:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789185890.371413:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789185890.371440:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789185890.371458:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789185890.371487:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789185890.371504:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789185890.371593:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789185890.371623:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789185890.371629:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789185890.371737:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185890.371806:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.371869:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898498688 00000100:00100000:3.0:1789185890.371878:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898498688 00000100:00100000:3.0:1789185890.379352:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789185890.379373:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898498688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185890.379566:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898498688:12345-0@lo:501:mount.lustre.0 Request processed in 200us (7759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185890.379575:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789185890.379647:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7ad7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789185890.379672:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789185890.379720:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185890.379770:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.379795:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f30024c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789185890.380697:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898498816 00000100:00100000:1.0:1789185890.380709:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898498816 00000100:00100000:1.0:1789185890.380755:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789185890.380765:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898498816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185890.380874:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898498816:12345-0@lo:503:mount.lustre.0 Request processed in 111us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185890.380882:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789185890.381708:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789185890.382275:0:18657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789185890.382381:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185890.382456:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.382521:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f30024c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789185890.382886:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898498944 00000100:00100000:1.0:1789185890.382897:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898498944 00000100:00100000:1.0:1789185890.382981:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789185890.382991:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898498944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185890.383124:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898498944:12345-0@lo:502:mount.lustre.0 Request processed in 134us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185890.383133:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789185890.383329:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898498944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185890.383731:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789185890.383765:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789185890.383783:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789185890.383799:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789185890.383815:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789185890.383826:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789185890.383838:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789185890.383849:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789185890.383880:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789185890.383899:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789185890.385712:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789185890.385733:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789185890.385750:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789185890.385765:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789185890.385783:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789185890.385801:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789185890.385816:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789185890.385831:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789185890.386258:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789185890.386293:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789185890.386308:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789185890.386322:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789185890.386334:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789185890.386349:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789185890.386448:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789185890.386467:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789185890.386610:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789185890.386628:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789185890.386646:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789185890.386661:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789185890.386675:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789185890.386687:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789185890.386700:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789185890.386714:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789185890.386727:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789185890.386742:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789185890.386756:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789185890.386770:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789185890.386784:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789185890.386798:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789185890.386828:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789185890.386844:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789185890.386856:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789185890.386881:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789185890.386894:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789185890.386905:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789185890.386942:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789185890.386956:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789185890.387012:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898499072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185890.387092:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.387149:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898499072 00000100:00100000:3.0:1789185890.387808:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898499072 00000100:00100000:3.0:1789185890.387874:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789185890.387883:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898499072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185890.388027:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898499072:12345-0@lo:502:mount.lustre.0 Request processed in 145us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185890.388034:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789185890.388098:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f30024c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185890.388121:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898499072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185890.392069:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789185890.392113:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789185890.392184:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898499200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185890.392266:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.392311:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898499200 00000100:00100000:3.0:1789185890.392319:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898499200 00000100:00100000:3.0:1789185890.392365:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789185890.393239:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f30024c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185890.393602:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898499200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185890.393814:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898499200:12345-0@lo:502:mount.lustre.0 Request processed in 1438us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185890.393824:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789185890.396126:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898499200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789185890.396601:0:18657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789185890.396618:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789185890.405757:0:18683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789185890.405775:0:18683:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98f2f27a0000) 00000020:00000080:1.0:1789185890.405799:0:18683:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789185890.405885:0:18683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f2e65a0800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789185890.405889:0:18683:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2e65a0800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789185890.405892:0:18683:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2e65a0800 3 00010000:00080000:1.0:1789185890.405987:0:18683:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f2c2af0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.148@tcp at head 00010000:00010000:1.0:1789185890.407642:0:18683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789185890.407826:0:18683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789185890.407865:0:18683:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789185890.407876:0:18683:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xda5c730d5a74112 00000100:00080000:1.0:1789185890.407886:0:18683:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185890.407896:0:18683:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f2c2af0800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185890.407961:0:18683:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b1500 x1876096898499328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789185890.407987:0:18683:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789185890.408012:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898499328:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789185890.408085:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.410786:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898499328 00000100:00100000:3.0:1789185890.410803:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898499328 00000100:00100000:3.0:1789185890.410842:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185890.410850:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876096898499328:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789185890.410881:0:17156:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1789185890.410930:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xda5c730d5a74119 00000004:00100000:3.0:1789185890.410948:0:17156:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789185890.410983:0:17156:0:(import.c:65:import_set_state_nolock()) ffff98f1c201f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185890.411065:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876096898499328:12345-0@lo:38:llog_process_th.0 Request processed in 213us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185890.411072:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789185890.411242:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c34b1500 x1876096898499328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185890.411253:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185890.411261:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789185890.411269:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789185890.411274:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789185890.411276:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c2af0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789185890.411281:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876096898499328:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789185890.416120:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185890.416127:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789185890.416130:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185890.416134:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789185890.416171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185890.416174:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789185890.416176:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789185890.416179:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789185890.416970:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898499712:0@lo:400:kworker.0 00000100:00100000:0.0:1789185890.417034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185890.417069:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185890.417074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898499584:0@lo:400:kworker.0 00000100:00100000:0.0:1789185890.417092:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185890.417129:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898499712 00000100:00100000:0.0:1789185890.417135:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898499712 00000100:00100000:0.0:1789185890.417188:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789185890.417198:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898499712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185890.417203:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898499456:0@lo:400:kworker.0 00000100:00100000:3.0:1789185890.417238:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185890.417255:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898499712:12345-0@lo:400:kworker.0 Request processed in 59us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.417264:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185890.417272:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185890.417280:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898499840:0@lo:400:kworker.0 00000100:00100000:0.0:1789185890.417281:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898499456 00000100:00100000:0.0:1789185890.417286:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898499456 00000100:00100000:0.0:1789185890.417304:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789185890.417314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185890.417314:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898499456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185890.417353:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898499584 00000100:00100000:3.0:1789185890.417358:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898499584 00000100:00100000:0.0:1789185890.417369:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898499456:12345-0@lo:400:kworker.0 Request processed in 58us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.417375:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789185890.417396:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898499840 00000100:00100000:0.0:1789185890.417400:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898499840 00000100:00100000:3.0:1789185890.417407:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185890.417417:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898499584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185890.417419:0:17155:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789185890.417429:0:17155:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789185890.417456:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898499584:12345-0@lo:400:kworker.0 Request processed in 41us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185890.417462:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789185890.417471:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c19b2a00 x1876096898499584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185890.417485:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898499584:0@lo:400:kworker.0 00000100:00100000:3.0:1789185890.417488:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185890.417498:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898499840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185890.417505:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898499712:0@lo:400:kworker.0 00000100:00100000:0.0:1789185890.417654:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898499456:0@lo:400:kworker.0 00000100:00100000:3.0:1789185890.417696:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898499840:12345-0@lo:400:kworker.0 Request processed in 197us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185890.417703:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789185890.417732:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c19b0e00 x1876096898499840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185890.417748:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898499840:0@lo:400:kworker.0 00000020:01000004:3.0:1789185890.418193:0:18683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789185890.418207:0:18683:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98f300180000) 00000020:00000080:3.0:1789185890.418228:0:18683:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789185890.418312:0:18683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f2e65a0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789185890.418316:0:18683:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f2e65a0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789185890.418318:0:18683:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f2e65a0800 3 00010000:00080000:3.0:1789185890.418353:0:18683:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c2018000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.148@tcp at head 00010000:00010000:3.0:1789185890.420406:0:18683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789185890.420630:0:18683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789185890.420689:0:18683:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789185890.420701:0:18683:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xda5c730d5a74127 00000100:00080000:3.0:1789185890.420711:0:18683:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789185890.420721:0:18683:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98f1c2018000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185890.420756:0:18683:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c4157800 x1876096898499968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789185890.420799:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876096898499968:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789185890.420865:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185890.420946:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898499968 00000100:00100000:3.0:1789185890.420953:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898499968 00000100:00100000:3.0:1789185890.420988:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185890.420996:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876096898499968:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789185890.421021:0:17156:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1789185890.421067:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xda5c730d5a7412e 00000004:00100000:3.0:1789185890.421083:0:17156:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789185890.421114:0:17156:0:(import.c:65:import_set_state_nolock()) ffff98f1c2019800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185890.421181:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876096898499968:12345-0@lo:38:llog_process_th.0 Request processed in 184us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185890.421702:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789185890.421752:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f1c4157800 x1876096898499968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185890.421762:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185890.421770:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789185890.421777:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789185890.421781:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789185890.421783:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c2018000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789185890.421796:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876096898499968:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789185890.421886:0:18683:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789185890.421932:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185890.421937:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185890.421940:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185890.421943:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185890.421947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185890.421950:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185890.421953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185890.421956:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789185890.428295:0:18683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789185890.428679:0:18657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789185890.428707:0:18657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789185890.428771:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a740fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74104 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185890.428784:0:18657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3400/0xda5c730d5a740fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74104 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789185890.428846:0:18657:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789185890.428848:0:18657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185890.428850:0:18657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185890.428851:0:18657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185890.428852:0:18657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185890.428853:0:18657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185890.428855:0:18657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185890.428856:0:18657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185890.428863:0:18657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185890.428867:0:18657:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789185890.428869:0:18657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789185890.428870:0:18657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185890.428871:0:18657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185890.428872:0:18657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185890.428873:0:18657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185890.428874:0:18657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185890.428875:0:18657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185890.428876:0:18657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185890.428877:0:18657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789185890.428903:0:18657:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789185890.428944:0:18657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898500096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789185890.429018:0:18657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185890.429058:0:18657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d82510c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185890.429519:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898500096 00000100:00100000:1.0:1789185890.429528:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898500096 00000100:00100000:1.0:1789185890.429592:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789185890.429602:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:18657:x1876096898500096:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789185890.429817:0:17149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789185890.429833:0:17149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789185890.444391:0:17149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789185890.444427:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789185890.444699:0:17171:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789185890.444705:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789185890.444731:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.444765:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74078 expref: 21 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.444773:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74086 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.444780:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.444843:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a74086 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.444860:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a74086 expref: 21 pid: 17147 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185890.444878:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898500224:0@lo:104: 00000100:00100000:0.0:1789185890.444973:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185890.445023:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a74078 expref: 21 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445032:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a74078 expref: 21 pid: 17150 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185890.445039:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898500352:0@lo:104: 00000100:00100000:0.0:1789185890.445067:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185890.445092:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c3451180 going to sleep for 11 seconds 00000100:00100000:0.0:1789185890.445119:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789185890.445134:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898500224 00000100:00100000:0.0:1789185890.445141:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898500224 00000100:00100000:0.0:1789185890.445199:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898500352 00000100:00100000:0.0:1789185890.445203:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898500352 00000100:00100000:0.0:1789185890.445217:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185890.445225:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+4:17171:x1876096898500224:12345-0@lo:104: 00010000:00010000:0.0:1789185890.445238:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445288:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185890.445293:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+4:17171:x1876096898500224:12345-0@lo:104: Request processed in 70us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.445301:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185890.445317:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185890.445322:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:17171:x1876096898500352:12345-0@lo:104: 00010000:00010000:0.0:1789185890.445329:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445360:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789185890.445365:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:17171:x1876096898500352:12345-0@lo:104: Request processed in 44us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.445370:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789185890.445412:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185890.445417:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445424:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e200 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185890.445428:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445437:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185890.445465:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185890.445471:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185890.445500:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445506:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185890.445527:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445534:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f1c402e200/0xda5c730d5a74086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a7408d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445548:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185890.445551:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445557:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d600 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185890.445560:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445566:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185890.445572:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185890.445576:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185890.445594:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445599:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185890.445613:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445620:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c166d600/0xda5c730d5a74078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a7407f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445635:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185890.445637:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185890.445638:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185890.445657:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898500480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185890.445685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185890.445717:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898500608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185890.445739:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185890.445772:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898500480 00000100:00100000:0.0:1789185890.445776:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898500480 00010000:00010000:0.0:1789185890.445795:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a74086 expref: 22 pid: 17147 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185890.445814:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898500608 00000100:00100000:0.0:1789185890.445817:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898500608 00010000:00010000:0.0:1789185890.445827:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a74078 expref: 23 pid: 17150 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185890.445839:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185890.445846:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:3636:x1876096898500480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185890.445855:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185890.445866:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a74086 expref: 23 pid: 17147 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445875:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a74086 expref: 23 pid: 17147 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445889:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185890.445941:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:3636:x1876096898500480:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.445948:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789185890.445962:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789185890.445968:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:3637:x1876096898500608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185890.445976:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185890.445980:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a74078 expref: 22 pid: 17150 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.445988:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a74078 expref: 22 pid: 17150 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446001:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446009:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789185890.446021:0:17142:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007143200s 00010000:00010000:0.0:1789185890.446026:0:17142:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446033:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446051:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446057:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446062:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030c00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185890.446066:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446074:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446082:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446092:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185890.446118:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:3637:x1876096898500608:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.446123:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789185890.446191:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c166da00/0xda5c730d5a7408d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a74086 expref: 21 pid: 17147 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185890.446202:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898500224:0@lo:104: 00010000:00010000:0.0:1789185890.446213:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031400/0xda5c730d5a7407f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a74078 expref: 20 pid: 17150 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185890.446222:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898500352:0@lo:104: 00010000:00010000:0.0:1789185890.446239:0:17171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446253:0:17171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446259:0:17171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185890.446266:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0030c00/0xda5c730d5a74135 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185890.446295:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898500608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185890.446314:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898500480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789185890.446986:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185890.448007:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:18657:x1876096898500096:12345-0@lo:253:mount.lustre.0 Request processed in 18402us (18983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185890.448020:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789185890.448634:0:18657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:18657:1876096898500096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789185890.448651:0:18657:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789185890.448654:0:18657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789185890.448656:0:18657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789185890.448657:0:18657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789185890.448659:0:18657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789185890.448660:0:18657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789185890.448661:0:18657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789185890.448663:0:18657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789185890.448665:0:18657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789185890.448666:0:18657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789185890.448680:0:18657:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1789185890.460885:0:18657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789185890.472599:0:18657:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789185890.472610:0:18657:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789185890.472645:0:18657:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789185890.472682:0:18657:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789185890.472701:0:18657:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789185890.472734:0:18657:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789185890.479332:0:18657:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185890.479577:0:18657:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789185890.729082:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789185891.473794:0:18739:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185891.474284:0:18739:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789185891.752090:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789185891.924363:0:17153:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789185891.924373:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f1c316e800 from 9 10000000:01000000:3.0:1789185891.924378:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185891.924423:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185891.924436:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185891.924448:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185891.924476:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898500736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185891.924552:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185891.924653:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f30024ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789185891.928556:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898500736 00000100:00100000:0.0:1789185891.928572:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898500736 00000100:00100000:1.0:1789185891.928712:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789185891.928724:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+19:17153:x1876096898500736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185891.928741:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185891.928771:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a7413c expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185891.928801:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a7413c expref: 20 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185891.928812:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7413c expref: 20 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185891.928821:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0200, rc 0) 00000100:00100000:1.0:1789185891.928903:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:17153:x1876096898500736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (4351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185891.928925:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789185891.929147:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898500736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185891.929167:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185891.929177:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185891.929272:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898500864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789185891.929312:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185891.929351:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6710d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789185891.929407:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898500864 00000100:00100000:1.0:1789185891.929412:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898500864 00000100:00100000:1.0:1789185891.929450:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789185891.929458:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:17153:x1876096898500864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789185891.929473:0:17149:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789185891.929491:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789185891.929494:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789185891.929584:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:17153:x1876096898500864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185891.929593:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789185891.929718:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898500864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789185891.929778:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789185891.929787:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185891.929795:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185891.929806:0:17153:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789185891.929808:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f1c41b6000 from 9 10000000:01000000:0.0:1789185891.929811:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789185891.929832:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185891.929840:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185891.929848:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185891.929862:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898500992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789185891.929887:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185891.929985:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6710d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185891.935784:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898500992 00000100:00100000:3.0:1789185891.935801:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898500992 00000100:00100000:3.0:1789185891.935862:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789185891.935873:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:17153:x1876096898500992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185891.935893:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185891.936023:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a7414a expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185891.936056:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a7414a expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185891.936068:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7414a expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185891.936078:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c13a2400, rc 0) 00000100:00100000:3.0:1789185891.936160:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:17153:x1876096898500992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (6271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185891.936167:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789185891.936528:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898500992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789185891.936561:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185891.936571:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185891.936630:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898501120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789185891.936669:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185891.936829:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c6710d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789185891.939221:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898501120 00000100:00100000:3.0:1789185891.939237:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898501120 00000100:00100000:3.0:1789185891.939341:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789185891.939353:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:17153:x1876096898501120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789185891.939381:0:17150:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789185891.939405:0:17150:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789185891.939408:0:17150:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789185891.939647:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:17153:x1876096898501120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 296us (2976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185891.939655:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789185891.939825:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898501120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789185891.939896:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789185891.939933:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185891.939947:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185892.774044:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185893.799169:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185893.799206:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898501248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185893.799282:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185893.799377:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898501248 00000100:00100000:3.0:1789185893.799398:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898501248 00000100:00100000:3.0:1789185893.799451:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185893.799461:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898501248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185893.799501:0:17896:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789185893.799550:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898501248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185893.799556:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789185893.799634:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898501248:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789185893.800591:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185894.311226:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185894.311247:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898501376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185894.311312:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185894.311369:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898501376 00000100:00100000:2.0:1789185894.311391:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898501376 00000100:00100000:2.0:1789185894.311433:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185894.311441:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898501376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185894.311471:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789185894.311512:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898501376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185894.311518:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789185894.311561:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898501376:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185894.822249:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789185895.014739:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789185895.847483:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789185895.848892:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185895.848898:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185895.848901:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185895.848904:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185895.848939:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185895.848942:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789185895.848945:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185895.848948:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789185895.849176:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898501760:0@lo:400:kworker.0 00000100:00100000:1.0:1789185895.849248:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185895.849295:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898502272:0@lo:400:kworker.0 00000100:00100000:1.0:1789185895.849324:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185895.849348:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789185895.849354:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898501632:0@lo:400:kworker.0 00000100:00100000:1.0:1789185895.849378:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185895.849408:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898502144:0@lo:400:kworker.0 00000100:00100000:1.0:1789185895.849431:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185895.849462:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898501760 00000100:00100000:1.0:1789185895.849470:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898501760 00000100:00100000:1.0:1789185895.849512:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898502272 00000100:00100000:1.0:1789185895.849514:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898502272 00000100:00100000:1.0:1789185895.849549:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898502144 00000100:00100000:1.0:1789185895.849553:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898502144 00000100:00100000:1.0:1789185895.849572:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185895.849581:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898501760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185895.849636:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898501760:12345-0@lo:400:kworker.0 Request processed in 55us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185895.849644:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185895.849660:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185895.849666:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898502272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185895.849693:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898502272:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185895.849698:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185895.849709:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185895.849715:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898502144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185895.849739:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898502144:12345-0@lo:400:kworker.0 Request processed in 24us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185895.849755:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185895.849779:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898501632 00000100:00100000:1.0:1789185895.849783:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898501632 00000100:00100000:1.0:1789185895.849811:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789185895.849817:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898501632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185895.849851:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898501632:12345-0@lo:400:kworker.0 Request processed in 34us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185895.849856:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789185895.849888:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185895.849892:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185895.849945:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898501632:0@lo:400:kworker.0 00010000:00080000:1.0:1789185895.849958:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c4155880 x1876096898502144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185895.849967:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898502144:0@lo:400:kworker.0 00010000:00080000:1.0:1789185895.849976:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c4155500 x1876096898501760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185895.849984:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898501760:0@lo:400:kworker.0 00010000:00080000:1.0:1789185895.850006:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c4154a80 x1876096898502272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185895.850013:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898502272:0@lo:400:kworker.0 00000100:00100000:3.0:1789185895.850485:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898501504:0@lo:400:kworker.0 00000100:00100000:3.0:1789185895.850526:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185895.850654:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898502016:0@lo:400:kworker.0 00000100:00100000:3.0:1789185895.850680:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185895.850698:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185895.850705:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898501888:0@lo:400:kworker.0 00000100:00100000:3.0:1789185895.850862:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185895.850893:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898501504 00000100:00100000:3.0:1789185895.850927:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898501504 00000100:00100000:3.0:1789185895.850962:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789185895.850970:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:3636:x1876096898501504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185895.851357:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:3636:x1876096898501504:12345-0@lo:400:kworker.0 Request processed in 387us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185895.851365:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789185895.851405:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898501504:0@lo:400:kworker.0 00000100:00100000:3.0:1789185895.851444:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898501888 00000100:00100000:3.0:1789185895.851447:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898501888 00000100:00100000:3.0:1789185895.851470:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789185895.851476:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898501888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185895.851512:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898501888:12345-0@lo:400:kworker.0 Request processed in 36us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185895.851518:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789185895.851779:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898502016 00000100:00100000:1.0:1789185895.851784:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898502016 00000100:00100000:1.0:1789185895.851812:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789185895.851819:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898502016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185895.851863:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898502016:12345-0@lo:400:kworker.0 Request processed in 45us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185895.851871:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185895.851950:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898501888:0@lo:400:kworker.0 00010000:00080000:3.0:1789185895.851967:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c4157800 x1876096898502016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185895.851987:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898502016:0@lo:400:kworker.0 00010000:00010000:1.0:1789185896.872752:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789185897.091574:0:19029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789185897.897608:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789185897.980155:0:19081:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789185897.980506:0:19081:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789185898.598399:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185883/real 1789185883] req@ffff98f2f758ce00 x1876096898494208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185898 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185898.598428:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f2f758ce00 x1876096898494208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185898 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185898.598437:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185883/real 1789185883] req@ffff98f2f758e680 x1876096898494336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185898 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185898.598459:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f2f758e680 x1876096898494336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185898 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789185898.598477:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c3526000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185898.604383:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789185898.604398:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898494208:0@lo:8:kworker.0 00000100:00080000:0.0:1789185898.604414:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185898.604423:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789185898.604427:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898494336:0@lo:8:kworker.0 00000100:00080000:0.0:1789185898.604522:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185898.604526:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185898.604529:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185898.604532:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789185898.604554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185898.604558:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789185898.604560:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f1c3526000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185898.604565:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 522 00000100:00080000:0.0:1789185898.604569:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789185898.604580:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f1c3526000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185898.604599:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c3487480 x1876096898502912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789185898.604612:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789185898.604614:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789185898.604630:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789185898.604634:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 522 00000100:00080000:0.0:1789185898.604636:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789185898.604641:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f2c7c41800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185898.604651:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c3485f80 x1876096898503040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185898.604695:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898502784:0@lo:400:kworker.0 00000100:00100000:0.0:1789185898.604757:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185898.604790:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789185898.604796:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898502656:0@lo:400:kworker.0 00000100:00100000:0.0:1789185898.604819:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185898.604838:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898503424:0@lo:400:kworker.0 00000100:00100000:0.0:1789185898.604862:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185898.604891:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898502784 00000100:00100000:0.0:1789185898.604898:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898502784 00000100:00100000:0.0:1789185898.604959:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789185898.605628:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898502784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185898.605692:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898502784:12345-0@lo:400:kworker.0 Request processed in 70us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185898.605699:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789185898.605729:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898502656 00000100:00100000:0.0:1789185898.605734:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898502656 00000100:00100000:0.0:1789185898.605761:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898503424 00000100:00100000:0.0:1789185898.605764:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898503424 00000100:00100000:0.0:1789185898.605792:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789185898.605798:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898502656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185898.605829:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898502656:12345-0@lo:400:kworker.0 Request processed in 31us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185898.605842:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789185898.605855:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789185898.605861:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898503424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185898.605891:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898503424:12345-0@lo:400:kworker.0 Request processed in 30us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185898.605896:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789185898.605938:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789185898.606020:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3486680 x1876096898502656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185898.606033:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898502656:0@lo:400:kworker.0 00010000:00080000:0.0:1789185898.606044:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3485180 x1876096898503424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185898.606051:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898503424:0@lo:400:kworker.0 00000100:00100000:0.0:1789185898.606060:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898502784:0@lo:400:kworker.0 00000100:00100000:0.0:1789185898.606088:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898502912:0@lo:8:kworker.0 00000100:00100000:0.0:1789185898.606128:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185898.606170:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898502912 00000100:00100000:0.0:1789185898.606173:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898503040:0@lo:8:kworker.0 00000100:00100000:1.0:1789185898.606175:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898502912 00000100:00100000:0.0:1789185898.606192:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185898.606204:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898503040 00000100:00100000:1.0:1789185898.606207:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898503040 00000100:00100000:1.0:1789185898.606218:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185898.606224:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898502912:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789185898.606247:0:18662:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1789185898.606344:0:18662:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a74158 00002000:00100000:1.0:1789185898.606358:0:18662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98f1c10b6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789185898.606363:0:18662:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789185898.606366:0:18662:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789185898.607223:0:18662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789185898.607252:0:18662:0:(import.c:65:import_set_state_nolock()) ffff98f1c10b5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185898.607390:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876096898502912:12345-0@lo:8:kworker.0 Request processed in 1165us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185898.607398:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185898.607420:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185898.607426:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898503040:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789185898.607441:0:18662:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789185898.608751:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898502400:0@lo:400:kworker.0 00000100:00100000:3.0:1789185898.608813:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185898.608863:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898503168:0@lo:400:kworker.0 00000100:00100000:3.0:1789185898.608893:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185898.608942:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789185898.608956:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898502528:0@lo:400:kworker.0 00000100:00100000:3.0:1789185898.608985:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185898.609015:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898503296:0@lo:400:kworker.0 00000100:00100000:3.0:1789185898.609037:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185898.609079:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898502528 00000100:00100000:3.0:1789185898.609086:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898502528 00000100:00100000:3.0:1789185898.610293:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789185898.610304:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898502528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185898.610411:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898502528:12345-0@lo:400:kworker.0 Request processed in 108us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185898.610418:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789185898.610449:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898502400 00000100:00100000:3.0:1789185898.610456:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898502400 00000100:00100000:3.0:1789185898.610484:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789185898.610490:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:3635:x1876096898502400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185898.610523:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:3635:x1876096898502400:12345-0@lo:400:kworker.0 Request processed in 34us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185898.610530:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789185898.610562:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898503168 00000100:00100000:3.0:1789185898.610565:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898503168 00000100:00100000:3.0:1789185898.610589:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898503296 00000100:00100000:3.0:1789185898.610591:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898503296 00000100:00100000:3.0:1789185898.610619:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185898.610624:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898503168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185898.610654:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898503168:12345-0@lo:400:kworker.0 Request processed in 30us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185898.610660:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789185898.610680:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185898.610685:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898503296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185898.610714:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898503296:12345-0@lo:400:kworker.0 Request processed in 29us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185898.610720:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789185898.610756:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898502528:0@lo:400:kworker.0 00010000:00080000:3.0:1789185898.610771:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3486a00 x1876096898503296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185898.610780:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898503296:0@lo:400:kworker.0 00000100:00100000:3.0:1789185898.610788:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898502400:0@lo:400:kworker.0 00010000:00080000:3.0:1789185898.610797:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3484380 x1876096898503168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185898.610804:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898503168:0@lo:400:kworker.0 00000100:00080000:3.0:1789185898.610895:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789185898.612850:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3487480 x1876096898502912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185898.612866:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789185898.612879:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789185898.612888:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789185898.612894:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789185898.612898:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c3526000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789185898.612947:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789185898.612954:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898502912:0@lo:8:kworker.0 00000100:00100000:2.0:1789185898.613413:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898503552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185898.613475:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789185898.613555:0:17897:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789185898.613653:0:17897:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 537775744527ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789185898.613661:0:17897:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789185898.616715:0:17898:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789185898.616772:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17898:1876096898503680:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789185898.616838:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185898.616871:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48540 going to sleep for 11 seconds 00000100:00100000:0.0:1789185898.616931:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898503552 00000100:00100000:0.0:1789185898.616952:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898503552 00000100:00100000:0.0:1789185898.617018:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185898.617028:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1876096898503552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185898.617056:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789185898.617066:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185898.617862:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1876096898503552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 833us (4384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185898.617872:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789185898.617902:0:18663:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789185898.617939:0:18663:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789185898.619808:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898503680 00000100:00100000:3.0:1789185898.619822:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898503680 00000100:00100000:0.0:1789185898.621053:0:19112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185898.621070:0:19112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17898:x1876096898503680:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:2.0:1789185898.623295:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3486680 x1876096898503552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185898.623328:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898503552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185898.627944:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898503040:12345-0@lo:8:kworker.0 Request processed in 20476us (21710us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789185898.627960:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789185898.628290:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185898.628297:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185898.628301:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898503040:0@lo:8:kworker.0 00000004:00080000:2.0:1789185898.628977:0:17888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789185898.630440:0:19112:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789185898.630449:0:19112:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789185898.630545:0:19112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17898:x1876096898503680:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9476us (13703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185898.630556:0:19112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789185898.630876:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3485880 x1876096898503680/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789185914 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185898.630892:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17898:1876096898503680:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789185898.630937:0:17898:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789185898.630980:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17898:1876096898503808:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789185898.631027:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185898.631061:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48540 going to sleep for 11 seconds 00000100:00100000:3.0:1789185898.631128:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898503808 00000100:00100000:3.0:1789185898.631136:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898503808 00000100:00100000:3.0:1789185898.631183:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185898.631193:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17898:x1876096898503808:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789185898.631220:0:18663:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789185898.631271:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17898:x1876096898503808:12345-0@lo:5:osp-pre-0-1.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185898.631278:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789185898.631356:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3485880 x1876096898503808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185914 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185898.631367:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17898:1876096898503808:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789185898.631377:0:17898:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789185898.631408:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17898:1876096898503936:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789185898.631431:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185898.631497:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185898.631710:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898503936 00000100:00100000:1.0:1789185898.631715:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898503936 00000100:00100000:1.0:1789185898.631749:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789185898.631757:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17898:x1876096898503936:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789185898.631782:0:18662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1789185898.670711:0:18658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789185898.670734:0:18658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789185898.671229:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17898:x1876096898503936:12345-0@lo:5:osp-pre-0-1.0 Request processed in 39468us (39793us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789185898.671241:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789185898.671396:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3485880 x1876096898503936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185914 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185898.671408:0:17898:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789185898.671414:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17898:1876096898503936:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789185898.671430:0:17898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789185898.671486:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17898:1876096898504064:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789185898.671524:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185898.671551:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e7b48540 going to sleep for 11 seconds 00000100:00100000:1.0:1789185898.672986:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898504064 00000100:00100000:1.0:1789185898.673007:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898504064 00000100:00100000:1.0:1789185898.673072:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789185898.673082:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17898:x1876096898504064:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789185898.673186:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17898:x1876096898504064:12345-0@lo:900:osp-pre-0-1.0 Request processed in 105us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185898.673192:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789185898.673443:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c3485880 x1876096898504064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789185914 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185898.673459:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3485880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17898:1876096898504064:0@lo:900:osp-pre-0-1.0 00000020:00000004:3.0:1789185898.823306:0:19132:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789185898.823524:0:19132:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789185898.918528:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898504192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185898.918604:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185898.918732:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898504192 00000100:00100000:3.0:1789185898.918741:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898504192 00000100:00100000:3.0:1789185898.918791:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789185898.918801:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898504192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185898.918834:0:17896:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00010000:00010000:1.0:1789185898.919035:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185898.921247:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898504192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2429us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185898.921261:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789185898.921475:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898504192:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789185899.367046:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789185899.430346:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898504320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185899.430417:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185899.430695:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898504320 00000100:00100000:2.0:1789185899.430714:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898504320 00000100:00100000:2.0:1789185899.430770:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789185899.430780:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898504320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185899.430814:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789185899.430871:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898504320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185899.430878:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789185899.430934:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898504320:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789185899.943151:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185900.967174:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185901.993449:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185902.696294:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185882/real 1789185882] req@ffff98f2f758e300 x1876096898493056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185902 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185902.696327:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f2f758e300 x1876096898493056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185902 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185902.696351:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789185882/real 1789185882] req@ffff98f2f758c380 x1876096898493184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185902 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185902.696365:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f2f758c380 x1876096898493184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789185902 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789185902.696398:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f30104b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185902.696421:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789185902.696426:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898493056:0@lo:8:kworker.0 00000100:00080000:0.0:1789185902.696433:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185902.696446:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789185902.696449:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898493184:0@lo:8:kworker.0 00000100:00080000:3.0:1789185902.696492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185902.696496:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789185902.696498:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f30104b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185902.696503:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1789185902.696508:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789185902.696518:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f30104b800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185902.696538:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c4155500 x1876096898504704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185902.696556:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185902.696560:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789185902.696568:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185902.696572:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1789185902.696574:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789185902.696579:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f2f2752000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185902.696591:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c4155880 x1876096898504832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185902.696619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789185902.696699:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898504960:0@lo:400:kworker.0 00000100:00080000:3.0:1789185902.696751:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789185902.696754:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185902.696758:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1789185902.696761:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789185902.696768:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f2c7c41800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:0.0:1789185902.696769:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.696787:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758e680 x1876096898505344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789185902.696836:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898505600:0@lo:400:kworker.0 00000100:00100000:3.0:1789185902.696841:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898504448:0@lo:400:kworker.0 00000100:00100000:0.0:1789185902.696876:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.696887:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.696941:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898505216:0@lo:400:kworker.0 00000100:00100000:3.0:1789185902.696970:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.697225:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789185902.697232:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898504576:0@lo:400:kworker.0 00000100:00100000:1.0:1789185902.701999:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898505088:0@lo:400:kworker.0 00000100:00100000:3.0:1789185902.703538:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.703576:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898505472:0@lo:400:kworker.0 00000100:00100000:3.0:1789185902.703610:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185902.703630:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.703654:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898504448 00000100:00100000:3.0:1789185902.703663:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898504448 00000100:00100000:1.0:1789185902.703668:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898505728:0@lo:400:kworker.0 00000100:00100000:1.0:1789185902.703701:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.703728:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789185902.703751:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898504704:0@lo:8:kworker.0 00000100:00100000:1.0:1789185902.703802:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185902.703832:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898504832:0@lo:8:kworker.0 00000100:00100000:1.0:1789185902.703854:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185902.703873:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898505344:0@lo:8:kworker.0 00000100:00100000:1.0:1789185902.703896:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185902.703948:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898505216 00000100:00100000:1.0:1789185902.703953:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898505216 00000100:00100000:1.0:1789185902.704113:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898504704 00000100:00100000:1.0:1789185902.704117:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898504704 00000100:00100000:1.0:1789185902.704126:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898504832 00000100:00100000:1.0:1789185902.704127:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898504832 00000100:00100000:1.0:1789185902.704133:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898505344 00000100:00100000:1.0:1789185902.704135:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898505344 00000100:00100000:1.0:1789185902.704143:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185902.704150:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898505216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185902.704205:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898505216:12345-0@lo:400:kworker.0 Request processed in 56us (7234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185902.704211:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789185902.704226:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185902.704230:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1876096898504704:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789185902.704253:0:18664:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:1.0:1789185902.704280:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a7415f 00002000:00100000:1.0:1789185902.704293:0:18664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98f1c3522800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789185902.704297:0:18664:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789185902.704300:0:18664:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789185902.704367:0:18664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789185902.704398:0:18664:0:(import.c:65:import_set_state_nolock()) ffff98f1c3524000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185902.704438:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:3637:x1876096898504448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185902.704440:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1876096898504704:12345-0@lo:8:kworker.0 Request processed in 206us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185902.704451:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185902.704466:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185902.704471:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1876096898504832:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789185902.704483:0:18664:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789185902.704488:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:3637:x1876096898504448:12345-0@lo:400:kworker.0 Request processed in 751us (7600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185902.704497:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789185902.704516:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1876096898504832:12345-0@lo:8:kworker.0 Request processed in 42us (659us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789185902.704523:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789185902.704539:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185902.704546:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876096898505344:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789185902.704558:0:18663:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789185902.704584:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876096898505344:12345-0@lo:8:kworker.0 Request processed in 39us (688us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789185902.706107:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898504576 00000100:00100000:2.0:1789185902.706120:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898504576 00000100:00100000:2.0:1789185902.706165:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898505088 00000100:00100000:2.0:1789185902.706169:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898505088 00000100:00100000:2.0:1789185902.706185:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789185902.706192:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898504576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185902.706260:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898504576:12345-0@lo:400:kworker.0 Request processed in 69us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185902.706274:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789185902.706290:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789185902.706296:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898505088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185902.706341:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898505088:12345-0@lo:400:kworker.0 Request processed in 45us (2713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185902.706347:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789185902.706882:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898504960 00000100:00100000:2.0:1789185902.706995:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898504960 00000100:00100000:2.0:1789185902.707022:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898505600 00000100:00100000:2.0:1789185902.707025:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898505600 00000100:00100000:2.0:1789185902.707041:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898505472 00000100:00100000:2.0:1789185902.707044:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898505472 00000100:00100000:2.0:1789185902.707053:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898505728 00000100:00100000:2.0:1789185902.707056:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898505728 00000100:00100000:2.0:1789185902.707070:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185902.707077:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898504960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185902.707118:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898504960:12345-0@lo:400:kworker.0 Request processed in 42us (10353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185902.707124:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789185902.707137:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789185902.707143:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898505600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185902.707170:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898505600:12345-0@lo:400:kworker.0 Request processed in 28us (10295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185902.707175:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789185902.707185:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789185902.707190:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898505472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185902.707213:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898505472:12345-0@lo:400:kworker.0 Request processed in 24us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185902.707219:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789185902.707229:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789185902.707243:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898505728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185902.707270:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898505728:12345-0@lo:400:kworker.0 Request processed in 28us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185902.707275:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789185902.707836:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f2f758d880 x1876096898505600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185902.707853:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898505600:0@lo:400:kworker.0 00010000:00080000:0.0:1789185902.707868:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c4156680 x1876096898504960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185902.707876:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898504960:0@lo:400:kworker.0 00000100:00100000:3.0:1789185902.709214:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185902.709250:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898505088:0@lo:400:kworker.0 00000100:00080000:3.0:1789185902.709255:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789185902.709268:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f2f758df80 x1876096898505728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185902.709279:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898505728:0@lo:400:kworker.0 00000100:00080000:3.0:1789185902.709320:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185902.709324:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185902.709402:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898504576:0@lo:400:kworker.0 00010000:00080000:3.0:1789185902.709415:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f2f758ce00 x1876096898505472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185902.709424:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898505472:0@lo:400:kworker.0 00000100:00100000:3.0:1789185902.709433:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898504448:0@lo:400:kworker.0 00010000:00080000:3.0:1789185902.709443:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f2f758e300 x1876096898505216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789185918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185902.709451:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898505216:0@lo:400:kworker.0 00010000:00080000:0.0:1789185902.710056:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c4155500 x1876096898504704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185902.710074:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789185902.710083:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789185902.710093:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789185902.710100:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789185902.710103:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f30104b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789185902.710122:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789185902.710129:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898504704:0@lo:8:kworker.0 00000100:00080000:0.0:1789185902.710154:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185902.710158:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185902.710161:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898504832:0@lo:8:kworker.0 00000100:00080000:0.0:1789185902.710173:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789185902.710176:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789185902.710180:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898505344:0@lo:8:kworker.0 00000004:00080000:3.0:1789185902.710251:0:17180:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789185902.710828:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17180:1876096898505984:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789185902.710895:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.710960:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2d28276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185902.710978:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185902.710990:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898505856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185902.711017:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.711051:0:19112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898505984 00000100:00100000:3.0:1789185902.711058:0:19112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898505984 00000004:00080000:1.0:1789185902.711349:0:17179:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789185902.711438:0:17179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 541873529042ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789185902.711445:0:17179:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789185902.711827:0:19112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185902.711840:0:19112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17180:x1876096898505984:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789185902.712069:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898505856 00000100:00100000:3.0:1789185902.712075:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898505856 00000100:00100000:3.0:1789185902.712343:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185902.712353:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898505856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789185902.712372:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789185902.712433:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876096898505856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185902.712441:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789185902.712467:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789185902.712498:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f2f758e300 x1876096898505856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185902.712518:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898505856:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1789185902.716889:0:19112:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789185902.716903:0:19112:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789185902.716951:0:19112:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1789185902.729492:0:17135:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789185902.732180:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.732194:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.732220:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.732225:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.732231:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.732250:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.732261:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.732283:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.732312:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789185902.735021:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.735036:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735052:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.735057:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.735063:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735079:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735106:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735115:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735139:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789185902.735154:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185902.735161:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735168:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a2a00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185902.735174:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735183:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735201:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735209:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064cb80b/0xda5c730d5a74166 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735225:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185902.735234:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735241:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3a00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185902.735244:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735252:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735262:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735269:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58f2030/0xda5c730d5a7416d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.735281:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.735283:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.735285:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.736097:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.736901:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.737560:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.737576:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.737581:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.737586:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.737618:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.737628:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.737635:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.737655:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789185902.738470:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.738477:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738488:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.738491:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.738495:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738504:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738513:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738532:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738549:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789185902.738559:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185902.738565:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738573:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a2000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185902.738577:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738587:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738602:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738609:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000900cfb1b/0xda5c730d5a74174 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738625:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185902.738628:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738646:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185902.738651:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.738653:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.738673:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738693:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738701:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fbf759/0xda5c730d5a7417b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.738715:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.738717:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.738719:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.739583:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.739592:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.739603:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.739606:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.739610:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.739621:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.739637:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.739644:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.739668:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185902.739818:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.739825:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.739835:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.739839:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.739847:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.739874:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.739881:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bab71143/0xda5c730d5a74182 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.739897:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.739899:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.739901:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.740119:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.740126:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740135:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.740137:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.740141:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740149:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740156:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740163:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740200:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185902.740383:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.740388:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740397:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166da00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.740400:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740409:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740419:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740426:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee28432d/0xda5c730d5a74189 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740456:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.740458:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.740460:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.740484:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.740490:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740498:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.740502:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.740506:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740515:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740523:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740529:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740552:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185902.740570:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.740575:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740583:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166d600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.740587:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740596:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740609:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740617:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000977a2020/0xda5c730d5a74190 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.740633:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.740635:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.740637:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.740877:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.740884:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740893:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.740902:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.740941:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740954:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740964:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740971:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.740999:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185902.741020:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.741026:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741046:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.741050:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741058:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741070:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741076:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f72f24/0xda5c730d5a74197 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741092:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.741094:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.741096:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.741292:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.741300:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.741311:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.741314:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.741318:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.741328:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.741336:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.741349:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.741369:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185902.741490:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.741496:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741503:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c166c000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.741506:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741514:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741530:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741537:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec5cb48a/0xda5c730d5a7419e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.741553:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.741555:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.741556:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.742538:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.742548:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.742560:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.742565:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.742568:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.742578:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.742586:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.742593:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.742605:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185902.742933:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.742940:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.742949:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dae00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.742953:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.742961:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.742974:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.742982:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dfc31e5/0xda5c730d5a741a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.743014:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.743016:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.743018:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.743247:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.743254:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.743269:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.743273:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.743278:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.743287:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.743295:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.743303:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.743329:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185902.743568:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.743575:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.743584:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.743587:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.743596:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.743609:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.743618:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a65e243/0xda5c730d5a741ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.743633:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.743636:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.743638:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.743853:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.743859:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.743868:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.743871:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.743876:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.743884:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.743905:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.744335:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.744396:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789185902.749584:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.749596:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.749613:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.749618:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.749625:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.749642:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.749653:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.749661:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.749860:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185902.749869:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.749887:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021da800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.749892:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.749902:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.749948:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.749956:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df4690b/0xda5c730d5a741b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.749979:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.749983:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.749994:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dbc00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.749998:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.750006:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.750016:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.750029:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.750030:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.750033:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.753241:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789185902.753256:0:19112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e529aa3c/0xda5c730d5a741ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.753294:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.754132:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.754142:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754156:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.754161:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.754167:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754180:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754190:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754197:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754220:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789185902.754624:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.754642:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754650:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.754653:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.754657:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754667:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754678:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754686:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754705:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789185902.754715:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185902.754721:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754727:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185902.754731:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754739:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754769:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754778:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a0f7442/0xda5c730d5a741c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754795:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185902.754798:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754803:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021dac00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185902.754806:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754812:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754820:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754827:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cb76574/0xda5c730d5a741c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.754840:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.754842:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.754851:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.755196:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.755313:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.755320:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755329:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.755333:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.755337:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755354:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755362:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755369:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755389:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185902.755697:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.755703:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.755711:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f3021db600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.755715:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.755723:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.755735:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.755742:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a20e35f/0xda5c730d5a741cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.755757:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.755759:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.755761:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185902.755831:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.755837:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755844:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.755847:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.755851:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755870:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755878:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755884:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.755901:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789185902.756648:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.756655:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.756665:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.756668:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.756672:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.756682:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.756690:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.756707:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.756720:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789185902.757530:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.757539:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.757549:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.757552:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.757556:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.757566:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.757575:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.757582:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.757592:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789185902.757983:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.757990:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.758005:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.758007:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.758011:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.758019:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.758027:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.758036:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.758046:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1789185902.759292:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789185902.759306:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.759327:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dae00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.759332:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789185902.759806:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185902.759814:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.759825:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=541s v=(0 0) 00010000:00010000:3.0:1789185902.759829:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.759834:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.759845:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.759864:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.759871:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.759881:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1789185902.760308:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760328:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760336:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017544f72/0xda5c730d5a741d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760420:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789185902.760425:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760431:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dbc00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.760435:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760442:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760453:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760467:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065bf771f/0xda5c730d5a741dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760481:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789185902.760485:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760492:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.760495:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760503:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760514:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760520:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5173ee4/0xda5c730d5a741e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760536:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185902.760540:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760546:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.760556:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760563:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760573:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760580:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c06ece8d/0xda5c730d5a741eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760595:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.760599:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760605:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db200 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.760608:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760615:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760625:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760632:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dee6d62/0xda5c730d5a741f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.760655:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.760657:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.760659:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.760667:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185902.761557:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789185902.761565:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.761577:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1789185902.761581:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185902.761586:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.761597:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.761607:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.761615:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.761639:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185902.761947:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185902.761954:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.761965:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030200 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185902.761969:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.762061:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.762083:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.762092:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dda7178/0xda5c730d5a741f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.762111:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185902.762113:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185902.762115:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185902.763223:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789185902.763233:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763258:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1789185902.763262:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185902.763268:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763279:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763289:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763295:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763311:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185902.763321:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185902.763327:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763334:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185902.763339:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763410:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763435:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763442:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e4a1154/0xda5c730d5a74200 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.763458:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.763460:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185902.763462:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185902.765115:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789185902.765127:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.765142:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1789185902.765146:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185902.765151:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.765163:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.765174:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.765182:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185902.765215:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185902.766225:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185902.766237:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.766250:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185902.766255:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.766266:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.766287:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.766294:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008344c44b/0xda5c730d5a74207 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.766325:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185902.766328:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185902.766331:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185902.778150:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185902.778163:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.778180:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=541s v=(0 0) 00010000:00010000:2.0:1789185902.778185:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185902.778192:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.778207:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.778217:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.778225:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.778240:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789185902.778853:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185902.778859:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.778881:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=541s v=(0 0) 00010000:00010000:2.0:1789185902.778884:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.779258:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185902.779270:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.779280:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185902.779284:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.779293:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.779312:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.779320:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecd3b606/0xda5c730d5a7420e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.779338:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185902.779444:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.779458:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.779467:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.779475:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.779494:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185902.779810:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185902.779814:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789185902.779816:0:19112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185902.779827:0:19112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.779829:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402ee00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185902.779835:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.779842:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=541s v=(0 0) 00010000:00010000:2.0:1789185902.779849:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185902.779850:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.779856:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.779867:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.779870:0:19112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.779886:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083be873d/0xda5c730d5a74215 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185902.779902:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.779903:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185902.779938:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185902.780005:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185902.780482:0:19112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.780491:0:19112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185902.780516:0:19112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789185902.780569:0:19112:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1789185902.780664:0:19112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17180:x1876096898505984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 68825us (69765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185902.780677:0:19112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185902.780688:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17180:1876096898505984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789185902.780707:0:17180:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789185902.780757:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17180:1876096898506112:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789185902.780791:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185902.780821:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf20c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789185902.780875:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185902.780881:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.780903:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185902.781008:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.781017:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.781032:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.781039:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024493664/0xda5c730d5a7421c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185902.781056:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185902.781058:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185902.781059:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185902.781166:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898506112 00000100:00100000:2.0:1789185902.781173:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898506112 00000100:00100000:2.0:1789185902.781220:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789185902.781230:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1876096898506112:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789185902.781264:0:18663:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1789185902.792640:0:18658:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789185902.792679:0:18658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789185902.800941:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17180:x1876096898506112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19678us (20114us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789185902.800965:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185902.802747:0:17180:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789185902.802764:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17180:1876096898506112:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789185902.802781:0:17180:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1789185903.015256:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185904.038197:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185904.041258:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185904.041288:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898506240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185904.041397:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185904.041707:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898506240 00000100:00100000:0.0:1789185904.041716:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898506240 00000100:00100000:0.0:1789185904.041777:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185904.041787:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898506240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789185904.041817:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789185904.041870:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898506240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185904.041877:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185904.041960:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898506240:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789185904.043300:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185904.043570:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898506368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185904.043622:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185904.044327:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898506368 00000100:00100000:2.0:1789185904.044339:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898506368 00000100:00100000:2.0:1789185904.044396:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789185904.044545:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898506368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185904.044582:0:17161:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789185904.044701:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898506368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 295us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185904.044725:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789185904.048434:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898506368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185904.550310:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898506496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185904.550388:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185904.550724:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898506496 00000100:00100000:2.0:1789185904.550733:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898506496 00000100:00100000:2.0:1789185904.550787:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789185904.550797:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898506496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185904.550834:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789185904.550898:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898506496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185904.550938:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789185904.551873:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898506496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185905.062383:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789185905.189688:0:19477:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789185905.189691:0:19477:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789185905.189693:0:19477:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789185905.190406:0:19477:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98f1c201e800 00000020:01000004:3.0:1789185905.190425:0:19477:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789185905.190441:0:19477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789185905.190466:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98f1c2d98000) 00000020:00000080:3.0:1789185905.190487:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000040:00080000:1.0:1789185905.254814:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00100000:10000000:2.0:1789185905.271839:0:19477:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789185905.277163:0:19477:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789185905.277374:0:19477:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789185905.277766:0:19477:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789185905.278220:0:19477:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789185905.278407:0:19477:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789185905.278595:0:19477:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1789185905.280174:0:19477:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789185905.280389:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789185905.280404:0:19477:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789185905.280416:0:19477:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xda5c730d5a7422a 00000020:01000004:0.0:1789185905.280424:0:19477:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789185905.280454:0:19477:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.148@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789185905.280457:0:19477:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789185905.280464:0:19477:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789185905.280493:0:19477:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789185905.280497:0:19477:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789185905.291152:0:19477:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789185905.291196:0:19477:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.148@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789185905.291201:0:19477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789185905.291203:0:19477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789185905.291204:0:19477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185905.291206:0:19477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185905.291207:0:19477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185905.291208:0:19477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185905.291209:0:19477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789185905.291211:0:19477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185905.291213:0:19477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789185905.291217:0:19477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789185905.291219:0:19477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789185905.291220:0:19477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789185905.291221:0:19477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185905.291222:0:19477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185905.291223:0:19477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185905.291225:0:19477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185905.291226:0:19477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789185905.291227:0:19477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185905.291228:0:19477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789185905.291255:0:19477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789185905.291274:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898506624:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789185905.291346:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.291464:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789185905.291594:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898506624 00000100:00100000:3.0:1789185905.291602:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898506624 00000100:00100000:3.0:1789185905.291658:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789185905.291667:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:19477:x1876096898506624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789185905.291698:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789185905.291701:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789185905.291705:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789185905.292345:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:19477:x1876096898506624:12345-0@lo:253:mount.lustre.0 Request processed in 676us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185905.292355:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789185905.292495:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898506624:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789185905.292506:0:19477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789185905.292508:0:19477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789185905.292510:0:19477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789185905.292523:0:19477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789185905.292524:0:19477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789185905.292525:0:19477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789185905.292526:0:19477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789185905.292527:0:19477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789185905.292528:0:19477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789185905.292529:0:19477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789185905.292549:0:19477:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f1c201e800 from lustre-OST0001 10000000:01000000:0.0:1789185905.292577:0:19477:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789185905.292579:0:19477:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789185905.292589:0:19477:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f1c2073380 local copy 00010000:00010000:0.0:1789185905.292598:0:19477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185905.292676:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898506752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185905.292706:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.292777:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789185905.292811:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898506752 00000100:00100000:2.0:1789185905.292817:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898506752 00000100:00100000:2.0:1789185905.293012:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789185905.293022:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:19477:x1876096898506752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185905.293128:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:19477:x1876096898506752:12345-0@lo:501:mount.lustre.0 Request processed in 107us (420us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789185905.293136:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789185905.293356:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898506752:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789185905.293383:0:19477:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789185905.293400:0:19477:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789185905.293406:0:19477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.293415:0:19477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0c00/0xda5c730d5a73e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a73e87 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185905.293443:0:19477:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f1c201e800 10000000:01000000:0.0:1789185905.293448:0:19477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789185905.293453:0:19477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789185905.293455:0:19477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789185905.293459:0:19477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789185905.293470:0:19477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789185905.293492:0:19477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a74231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.293500:0:19477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a74231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.293509:0:19477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a74231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185905.293522:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898506880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185905.293550:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.293623:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185905.293720:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898506880 00000100:00100000:3.0:1789185905.293725:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898506880 00000100:00100000:3.0:1789185905.293759:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789185905.293767:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:19477:x1876096898506880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789185905.293776:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185905.293788:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30da200/0xda5c730d5a74238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a74231 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.293818:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30da200/0xda5c730d5a74238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a74231 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.293828:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30da200/0xda5c730d5a74238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74231 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.293837:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da200, rc 0) 00000100:00100000:3.0:1789185905.294126:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898506880:12345-0@lo:101:mount.lustre.0 Request processed in 359us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.294132:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789185905.294230:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898506880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185905.294243:0:19477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a74231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74238 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.294251:0:19477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a74231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74238 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789185905.295281:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789185905.296071:0:19477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789185905.299505:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789185905.299558:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789185905.299570:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789185905.299583:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789185905.299595:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789185905.299607:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789185905.299629:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789185905.299633:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789185905.299746:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185905.299805:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.301208:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b000 going to sleep for 11 seconds 00000100:00100000:1.0:1789185905.301280:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898507008 00000100:00100000:1.0:1789185905.301289:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898507008 00000100:00100000:1.0:1789185905.301419:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789185905.301430:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898507008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185905.301596:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898507008:12345-0@lo:501:mount.lustre.0 Request processed in 167us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185905.301604:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789185905.301678:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185905.301720:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789185905.301770:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.302134:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789185905.302571:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898507136 00000100:00100000:3.0:1789185905.302578:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898507136 00000100:00100000:3.0:1789185905.302610:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789185905.302619:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898507136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789185905.303617:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898507136:12345-0@lo:503:mount.lustre.0 Request processed in 994us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.303628:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789185905.303728:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789185905.304191:0:19477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789185905.304267:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185905.304317:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.304344:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185905.304581:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898507264 00000100:00100000:3.0:1789185905.304588:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898507264 00000100:00100000:3.0:1789185905.304617:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789185905.304625:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898507264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185905.305105:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898507264:12345-0@lo:502:mount.lustre.0 Request processed in 480us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.305114:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789185905.305229:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789185905.305555:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789185905.305583:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789185905.305596:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789185905.305608:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789185905.305621:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789185905.305633:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789185905.305645:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789185905.305657:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789185905.305685:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789185905.305718:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185905.305759:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.305839:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789185905.305936:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898507392 00000100:00100000:1.0:1789185905.305942:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898507392 00000100:00100000:3.0:1789185905.306168:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789185905.306178:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898507392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789185905.306275:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898507392:12345-0@lo:502:mount.lustre.0 Request processed in 99us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.306282:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789185905.306361:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789185905.306533:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789185905.306542:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789185905.307797:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789185905.307809:0:19481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789185905.307817:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789185905.307819:0:19481:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789185905.307825:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789185905.307842:0:19481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98f2c6fd19c0) 00000020:00000080:2.0:1789185905.307866:0:19481:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789185905.308144:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789185905.308230:0:19481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f1c201e800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789185905.308239:0:19481:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789185905.308247:0:19481:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xda5c730d5a74246 00010000:00010000:3.0:1789185905.314281:0:19481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789185905.315168:0:19481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789185905.317135:0:19481:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789185905.319283:0:19481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789185905.319296:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185905.319302:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185905.319304:0:19481:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789185905.319308:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185905.319312:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185905.319314:0:19481:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789185905.319317:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789185905.319319:0:19481:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789185905.319322:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185905.319324:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185905.319325:0:19481:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789185905.319328:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789185905.319330:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185905.319341:0:19481:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789185905.319345:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789185905.319995:0:19481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789185905.320003:0:19481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789185905.320005:0:19481:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789185905.320009:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789185905.322628:0:19477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789185905.322674:0:19477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789185905.324017:0:19477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a74231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74238 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.324034:0:19477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0031400/0xda5c730d5a74231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74238 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185905.324042:0:19477:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f1c201e800 from 1 10000000:01000000:0.0:1789185905.324045:0:19477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789185905.324083:0:19477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.324092:0:19477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.324103:0:19477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185905.324129:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789185905.324199:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.324250:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789185905.324321:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898507520 00000100:00100000:1.0:1789185905.324329:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898507520 00000100:00100000:1.0:1789185905.324392:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789185905.324403:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:19477:x1876096898507520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185905.324419:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185905.324432:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a7424d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.324457:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a7424d expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.324469:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7424d expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.324478:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0e00, rc 0) 00000100:00100000:1.0:1789185905.324520:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898507520:12345-0@lo:101:mount.lustre.0 Request processed in 119us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185905.324525:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789185905.324773:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789185905.324790:0:19477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.324800:0:19477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185905.329803:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789185905.330180:0:19477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185905.330715:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789185905.330742:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789185905.330759:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789185905.330764:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789185905.330847:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185905.331129:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185905.331222:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e79a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185905.334570:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898507648 00000100:00100000:3.0:1789185905.334583:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898507648 00000100:00100000:2.0:1789185905.334762:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789185905.334775:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898507648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185905.334990:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898507648:12345-0@lo:501:mount.lustre.0 Request processed in 218us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185905.334998:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789185905.335109:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789185905.335165:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789185905.335214:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.335578:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b000 going to sleep for 11 seconds 00000100:00100000:1.0:1789185905.335646:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898507776 00000100:00100000:1.0:1789185905.335654:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898507776 00000100:00100000:1.0:1789185905.335683:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789185905.335690:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898507776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185905.335831:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898507776:12345-0@lo:503:mount.lustre.0 Request processed in 141us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185905.335848:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789185905.336143:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507776:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789185905.336561:0:19477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789185905.336635:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185905.336680:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.336754:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185905.336861:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898507904 00000100:00100000:3.0:1789185905.336867:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898507904 00000100:00100000:1.0:1789185905.337425:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789185905.337435:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898507904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185905.337552:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898507904:12345-0@lo:502:mount.lustre.0 Request processed in 118us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185905.337559:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789185905.337696:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898507904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789185905.337931:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789185905.337962:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789185905.337977:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789185905.337989:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789185905.338002:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789185905.338014:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789185905.338027:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789185905.338040:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789185905.338051:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789185905.338079:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789185905.338093:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789185905.338122:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185905.338162:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.338188:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789185905.338318:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898508032 00000100:00100000:2.0:1789185905.338324:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898508032 00000100:00100000:2.0:1789185905.338359:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789185905.338378:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898508032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185905.338467:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898508032:12345-0@lo:502:mount.lustre.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185905.338474:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789185905.338663:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789185905.338705:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789185905.338713:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789185905.339535:0:19485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185905.339546:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185905.339548:0:19485:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789185905.339554:0:19485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f1c201e800 00000020:00000080:0.0:1789185905.339557:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185905.339564:0:19485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185905.339566:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185905.339568:0:19485:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789185905.339570:0:19485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185905.339573:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185905.339574:0:19485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789185905.339577:0:19485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f1c201e800 00000020:00000080:0.0:1789185905.339579:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185905.339637:0:19485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185905.339641:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185905.339642:0:19485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789185905.339645:0:19485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185905.339647:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185905.339648:0:19485:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185905.339651:0:19485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f1c201e800 00000020:00000080:0.0:1789185905.339653:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185905.339669:0:19485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185905.339672:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185905.339673:0:19485:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789185905.339676:0:19485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789185905.339678:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185905.339679:0:19485:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789185905.339682:0:19485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f1c201e800 00000020:00000080:0.0:1789185905.339684:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789185905.339703:0:19485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789185905.339712:0:19485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789185905.339714:0:19485:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789185905.339717:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789185905.343498:0:19477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789185905.343549:0:19477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185905.343574:0:19477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.343587:0:19477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185905.343652:0:19477:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789185905.343656:0:19477:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f1c201e800 10000000:01000000:1.0:1789185905.343659:0:19477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f1c201e800 10000000:01000000:1.0:1789185905.343663:0:19477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789185905.343668:0:19477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98f1c201e800 from 1 10000000:01000000:1.0:1789185905.343671:0:19477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789185905.343709:0:19477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0800/0xda5c730d5a7425b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.343718:0:19477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0800/0xda5c730d5a7425b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.343730:0:19477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0800/0xda5c730d5a7425b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185905.343766:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789185905.343838:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185905.343893:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f2789f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185905.347023:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898508160 00000100:00100000:1.0:1789185905.347040:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898508160 00000100:00100000:1.0:1789185905.347100:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789185905.347111:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:19477:x1876096898508160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185905.347128:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185905.347147:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74262 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a7425b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.347181:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a7425b expref: 24 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.347193:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2ff9c1800/0xda5c730d5a74262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7425b expref: 24 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.347202:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c1800, rc 0) 00000100:00100000:1.0:1789185905.347277:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508160:12345-0@lo:101:mount.lustre.0 Request processed in 168us (3438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185905.347283:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789185905.347345:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789185905.347365:0:19477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0800/0xda5c730d5a7425b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74262 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.347389:0:19477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0800/0xda5c730d5a7425b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74262 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789185905.350639:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1789185905.352566:0:19477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789185905.352839:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789185905.352869:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789185905.354689:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789185905.354721:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789185905.354739:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789185905.354767:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789185905.354783:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789185905.354795:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789185905.354808:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789185905.354822:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789185905.354836:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789185905.354851:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789185905.354864:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789185905.354891:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789185905.354904:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789185905.354945:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789185905.354962:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789185905.354977:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789185905.354991:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789185905.355007:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789185905.355020:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789185905.355048:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789185905.355066:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789185905.355079:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789185905.355094:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789185905.355106:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789185905.355119:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789185905.355132:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789185905.355145:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789185905.355170:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789185905.355182:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789185905.355194:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789185905.355207:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789185905.355219:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789185905.355231:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789185905.355245:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789185905.355256:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789185905.355281:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789185905.355296:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789185905.355309:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1789185905.355322:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789185905.355334:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789185905.355349:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789185905.355360:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789185905.355372:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789185905.355383:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789185905.355405:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789185905.355410:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789185905.355522:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185905.355588:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185905.355634:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185905.356257:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898508288 00000100:00100000:2.0:1789185905.356267:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898508288 00000100:00100000:2.0:1789185905.356326:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789185905.356336:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789185905.356481:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508288:12345-0@lo:501:mount.lustre.0 Request processed in 147us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185905.356489:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789185905.356731:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789185905.356770:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789185905.356814:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185905.356844:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300cf2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789185905.356986:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898508416 00000100:00100000:2.0:1789185905.356992:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898508416 00000100:00100000:2.0:1789185905.357018:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789185905.357025:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789185905.357108:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508416:12345-0@lo:503:mount.lustre.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185905.357115:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789185905.357538:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789185905.361301:0:19477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789185905.361417:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185905.361509:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185905.361597:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7424300 going to sleep for 11 seconds 00000100:00100000:2.0:1789185905.366247:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898508544 00000100:00100000:2.0:1789185905.366262:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898508544 00000100:00100000:2.0:1789185905.366342:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789185905.366352:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789185905.366758:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508544:12345-0@lo:502:mount.lustre.0 Request processed in 406us (5247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185905.366766:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789185905.369796:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185905.370650:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789185905.370686:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789185905.370701:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789185905.370713:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789185905.370743:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789185905.370761:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789185905.370774:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789185905.370786:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789185905.370797:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789185905.370807:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789185905.370818:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789185905.370828:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789185905.370840:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789185905.370854:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789185905.370867:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789185905.372140:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789185905.372177:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789185905.372194:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789185905.372206:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789185905.372223:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789185905.372255:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789185905.372270:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789185905.372283:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789185905.372297:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789185905.372311:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789185905.372326:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789185905.372339:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789185905.372353:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789185905.375981:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789185905.376053:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789185905.376066:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789185905.376078:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789185905.376091:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789185905.376104:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789185905.376117:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789185905.376130:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789185905.376167:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789185905.376182:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789185905.376195:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789185905.376208:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789185905.376220:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789185905.376233:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789185905.376246:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789185905.376259:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789185905.376272:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789185905.376284:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789185905.376298:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789185905.376312:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789185905.376373:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185905.376455:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185905.376514:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7424300 going to sleep for 11 seconds 00000100:00100000:0.0:1789185905.376810:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898508672 00000100:00100000:0.0:1789185905.376819:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898508672 00000100:00100000:0.0:1789185905.376899:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789185905.376926:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789185905.377059:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508672:12345-0@lo:502:mount.lustre.0 Request processed in 151us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185905.377067:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789185905.379061:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185905.379280:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789185905.379305:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789185905.379339:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185905.379407:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185905.379434:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f7424300 going to sleep for 11 seconds 00000100:00100000:1.0:1789185905.379460:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898508800 00000100:00100000:1.0:1789185905.379473:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898508800 00000100:00100000:1.0:1789185905.379530:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789185905.379539:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789185905.379644:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898508800:12345-0@lo:502:mount.lustre.0 Request processed in 105us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185905.379651:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789185905.379697:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898508800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789185905.379733:0:19477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789185905.379740:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789185905.384412:0:19490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789185905.384435:0:19490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98f2f27a4d40) 00000020:00000080:1.0:1789185905.384468:0:19490:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789185905.384576:0:19490:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f1c201e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789185905.384581:0:19490:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f1c201e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789185905.384583:0:19490:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f1c201e800 3 00010000:00080000:1.0:1789185905.384615:0:19490:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f2d0b91800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.148@tcp at head 00010000:00010000:1.0:1789185905.386731:0:19490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789185905.387060:0:19490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789185905.387111:0:19490:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789185905.387124:0:19490:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xda5c730d5a74270 00000100:00080000:1.0:1789185905.387136:0:19490:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185905.387149:0:19490:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f2d0b91800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185905.387190:0:19490:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b0380 x1876096898508928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789185905.387219:0:19490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789185905.387505:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898508928:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789185905.387596:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789185905.387693:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185905.387697:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789185905.387700:0:8:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185905.387705:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:3.0:1789185905.387708:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789185905.387714:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f2f2752000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185905.387728:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c35e0e00 x1876096898509312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185905.387773:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185905.387776:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789185905.387778:0:8:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185905.387781:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 541 00000100:00080000:3.0:1789185905.387784:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789185905.387788:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f2c7c41800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185905.387813:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c35e1500 x1876096898509824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789185905.387991:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898509312:0@lo:8:kworker.0 00000100:00100000:3.0:1789185905.388019:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.388039:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898509824:0@lo:8:kworker.0 00000100:00100000:3.0:1789185905.388062:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.388089:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898509568:0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.388114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.388131:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898510208:0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.388149:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.388164:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789185905.388170:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898509440:0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.388186:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.388199:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898510080:0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.388215:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.388236:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898508928 00000100:00100000:3.0:1789185905.388243:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898508928 00000100:00100000:3.0:1789185905.388262:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898510208 00000100:00100000:3.0:1789185905.388265:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898510208 00000100:00100000:3.0:1789185905.388294:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898509440 00000100:00100000:3.0:1789185905.388297:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898509440 00000100:00100000:3.0:1789185905.388309:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898510080 00000100:00100000:3.0:1789185905.388311:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898510080 00000100:00100000:3.0:1789185905.388325:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185905.388333:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898510208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.388378:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898510208:12345-0@lo:400:kworker.0 Request processed in 46us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.388392:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789185905.388408:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185905.388415:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898509440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.388442:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898509440:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.388448:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789185905.388460:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185905.388466:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898510080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.388491:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898510080:12345-0@lo:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.388496:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789185905.388508:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789185905.388512:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876096898508928:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789185905.388531:0:17155:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1789185905.388561:0:17155:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xda5c730d5a74277 00000004:00100000:3.0:1789185905.388576:0:17155:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789185905.388606:0:17155:0:(import.c:65:import_set_state_nolock()) ffff98f1c30fd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185905.388641:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1876096898508928:12345-0@lo:38:llog_process_th.0 Request processed in 127us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.388648:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789185905.388662:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789185905.388666:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789185905.388688:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c35e2d80 x1876096898509440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185905.388702:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898509440:0@lo:400:kworker.0 00010000:00080000:3.0:1789185905.388720:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c35e2300 x1876096898510080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185905.388728:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898510080:0@lo:400:kworker.0 00010000:00080000:3.0:1789185905.388737:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c35e0a80 x1876096898510208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185905.388746:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898510208:0@lo:400:kworker.0 00010000:00080000:3.0:1789185905.388772:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c34b0380 x1876096898508928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185905.388780:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185905.388786:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789185905.388793:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789185905.388798:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789185905.388801:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2d0b91800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789185905.388806:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876096898508928:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789185905.389140:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898509184:0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.389172:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.389192:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898509952:0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.389212:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.389229:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789185905.389235:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898509056:0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.389254:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.389272:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898509696:0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.389290:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.389324:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898509952 00000100:00100000:3.0:1789185905.389329:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898509952 00000100:00100000:3.0:1789185905.389354:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789185905.389361:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898509952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.389397:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898509952:12345-0@lo:400:kworker.0 Request processed in 36us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.389403:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789185905.389420:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898509312 00000100:00100000:3.0:1789185905.389423:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898509312 00000100:00100000:3.0:1789185905.389435:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898509824 00000100:00100000:3.0:1789185905.389438:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898509824 00000100:00100000:3.0:1789185905.389460:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898509184 00000100:00100000:3.0:1789185905.389463:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898509184 00000100:00100000:3.0:1789185905.389489:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898509696 00000100:00100000:3.0:1789185905.389491:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898509696 00000100:00100000:3.0:1789185905.389503:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185905.389508:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898509184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.389537:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898509184:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.389543:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789185905.389553:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185905.389558:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898509696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.389590:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898509696:12345-0@lo:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.389595:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789185905.389607:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185905.389611:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898509312:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789185905.389651:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898509312:12345-0@lo:8:kworker.0 Request processed in 39us (1631us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789185905.389663:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185905.389675:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185905.389679:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898509824:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789185905.389708:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898509824:12345-0@lo:8:kworker.0 Request processed in 28us (1645us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789185905.389714:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185905.389745:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898509696:0@lo:400:kworker.0 00000100:00100000:3.0:1789185905.389754:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898509184:0@lo:400:kworker.0 00010000:00080000:3.0:1789185905.389764:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c35e1f80 x1876096898509952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185905.389773:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898509952:0@lo:400:kworker.0 00000100:00080000:3.0:1789185905.389793:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185905.389805:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185905.389810:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789185905.389814:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789185905.389816:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898509312:0@lo:8:kworker.0 00000100:00100000:3.0:1789185905.389824:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789185905.389827:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789185905.389829:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789185905.389832:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898509824:0@lo:8:kworker.0 00000020:01000004:1.0:1789185905.390135:0:19490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789185905.390152:0:19490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98f2f27a19c0) 00000020:00000080:1.0:1789185905.390170:0:19490:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789185905.390251:0:19490:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f1c201e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789185905.390255:0:19490:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f1c201e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789185905.390257:0:19490:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f1c201e800 3 00010000:00080000:1.0:1789185905.390293:0:19490:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f1c2c69800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.148@tcp at head 00000100:00100000:2.0:1789185905.394575:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898509568 00000100:00100000:2.0:1789185905.394588:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898509568 00000100:00100000:2.0:1789185905.394638:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898509056 00000100:00100000:2.0:1789185905.394642:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898509056 00000100:00100000:2.0:1789185905.394663:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789185905.394673:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898509568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185905.394774:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898509568:12345-0@lo:400:kworker.0 Request processed in 102us (6658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185905.394780:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789185905.394806:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789185905.394811:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898509056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185905.394849:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898509056:12345-0@lo:400:kworker.0 Request processed in 37us (5593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185905.394854:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789185905.396145:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898509568:0@lo:400:kworker.0 00000100:00100000:2.0:1789185905.396186:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898509056:0@lo:400:kworker.0 00010000:00010000:1.0:1789185905.396612:0:19490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789185905.396841:0:19490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789185905.398206:0:19490:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789185905.398226:0:19490:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xda5c730d5a74285 00000100:00080000:1.0:1789185905.398236:0:19490:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789185905.398248:0:19490:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98f1c2c69800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:1.0:1789185905.398285:0:19490:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c34b1500 x1876096898510336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789185905.398318:0:19490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789185905.398816:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876096898510336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789185905.399222:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789185905.400112:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789185905.400182:0:19477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789185905.400215:0:19477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789185905.400245:0:19477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0800/0xda5c730d5a7425b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74262 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185905.400256:0:19477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0800/0xda5c730d5a7425b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74262 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789185905.400316:0:19477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789185905.400318:0:19477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789185905.400320:0:19477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185905.400321:0:19477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185905.400322:0:19477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185905.400324:0:19477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185905.400325:0:19477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789185905.400327:0:19477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185905.400328:0:19477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789185905.400338:0:19477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789185905.400341:0:19477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789185905.400342:0:19477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789185905.400343:0:19477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185905.400343:0:19477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185905.400344:0:19477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185905.400345:0:19477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185905.400346:0:19477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789185905.400347:0:19477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185905.400348:0:19477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789185905.400373:0:19477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789185905.400390:0:19477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898510464:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789185905.400442:0:19477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185905.400462:0:19477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce2573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185905.400484:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898510464 00000100:00100000:1.0:1789185905.400491:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898510464 00000100:00100000:1.0:1789185905.400530:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789185905.400538:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898510464:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789185905.400563:0:17149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789185905.400576:0:17149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789185905.401285:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898510336 00000100:00100000:2.0:1789185905.401292:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898510336 00000100:00100000:2.0:1789185905.401321:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185905.401327:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1876096898510336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789185905.401350:0:18686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:2.0:1789185905.401383:0:18686:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xda5c730d5a7428c 00000004:00100000:2.0:1789185905.401397:0:18686:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789185905.401428:0:18686:0:(import.c:65:import_set_state_nolock()) ffff98f1c4390800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185905.401484:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876096898510336:12345-0@lo:38:llog_process_th.0 Request processed in 156us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185905.401491:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789185905.401536:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f1c34b1500 x1876096898510336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789185915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185905.401546:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789185905.401553:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789185905.401560:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789185905.401564:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789185905.401566:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f1c2c69800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789185905.401580:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876096898510336:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1789185905.403579:0:17149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789185905.403600:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789185905.403773:0:17171:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789185905.403778:0:17171:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789185905.403798:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.403817:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7413c expref: 24 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.403823:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7414a expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.403829:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.403863:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a7414a expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185905.404144:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:19477:x1876096898510464:12345-0@lo:253:mount.lustre.0 Request processed in 3604us (3699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185905.404154:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789185905.404217:0:19477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:19477:1876096898510464:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789185905.404229:0:19477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789185905.404232:0:19477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789185905.404234:0:19477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789185905.404235:0:19477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789185905.404236:0:19477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789185905.404238:0:19477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789185905.404249:0:19477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789185905.404250:0:19477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789185905.404252:0:19477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789185905.404253:0:19477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789185905.404267:0:19477:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789185905.404782:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a7414a expref: 23 pid: 17147 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185905.404798:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898510592:0@lo:104: 00000100:00100000:0.0:1789185905.404846:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185905.405238:0:17171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a7413c expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405247:0:17171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a7413c expref: 23 pid: 17150 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185905.405257:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898510720:0@lo:104: 00000100:00100000:0.0:1789185905.405281:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185905.405303:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789185905.405323:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898510592 00000100:00100000:0.0:1789185905.405328:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898510592 00000100:00100000:0.0:1789185905.405362:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898510720 00000100:00100000:0.0:1789185905.405365:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898510720 00000100:00100000:0.0:1789185905.405378:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789185905.405388:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+4:17171:x1876096898510592:12345-0@lo:104: 00010000:00010000:0.0:1789185905.405401:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405446:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789185905.405452:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+4:17171:x1876096898510592:12345-0@lo:104: Request processed in 67us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185905.405459:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789185905.405474:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185905.405480:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:17171:x1876096898510720:12345-0@lo:104: 00010000:00010000:0.0:1789185905.405488:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405519:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789185905.405531:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:17171:x1876096898510720:12345-0@lo:104: Request processed in 51us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185905.405538:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789185905.405567:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898510592:0@lo:104: 00000100:00100000:0.0:1789185905.405575:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17171:1876096898510720:0@lo:104: 00010000:00010000:0.0:1789185905.405591:0:17171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405607:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185905.405614:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405621:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031a00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185905.405624:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405632:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185905.405639:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185905.405645:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185905.405681:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405687:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185905.405705:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405721:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031a00/0xda5c730d5a7414a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74151 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405733:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185905.405736:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405742:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3e00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:0.0:1789185905.405745:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405751:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789185905.405756:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789185905.405761:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789185905.405773:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405778:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789185905.405784:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405790:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c13a3e00/0xda5c730d5a7413c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74143 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185905.405802:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185905.405809:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185905.405811:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185905.405817:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185905.405828:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898510848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185905.405857:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185905.406267:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898510976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789185905.406297:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185905.407133:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898510848 00000100:00100000:3.0:1789185905.407148:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898510848 00010000:00010000:3.0:1789185905.407179:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7414a expref: 24 pid: 17147 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185905.407209:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898510976 00000100:00100000:3.0:1789185905.407211:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898510976 00010000:00010000:3.0:1789185905.407222:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7413c expref: 25 pid: 17150 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185905.407235:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185905.407243:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+25:3637:x1876096898510848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185905.407259:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185905.407264:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7414a expref: 25 pid: 17147 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407277:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a7414a expref: 25 pid: 17147 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407293:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c13a2400/0xda5c730d5a74151 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a7414a expref: 25 pid: 17147 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407310:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185905.407360:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3637:x1876096898510848:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.407368:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185905.407384:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789185905.407391:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:3638:x1876096898510976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185905.407398:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185905.407402:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7413c expref: 23 pid: 17150 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407422:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a7413c expref: 23 pid: 17150 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407431:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2ff9c0200/0xda5c730d5a74143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a7413c expref: 23 pid: 17150 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407442:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407450:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789185905.407465:0:17141:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007143200s 00010000:00010000:3.0:1789185905.407471:0:17141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407478:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407485:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407491:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407497:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185905.407501:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407509:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407531:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407540:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185905.407569:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:3638:x1876096898510976:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185905.407574:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789185905.407596:0:17171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407604:0:17171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185905.407610:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74293 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185905.407642:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898510976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789185905.410972:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3637:1876096898510848:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789185905.411576:0:19477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789185905.421774:0:19477:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789185905.421783:0:19477:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789185905.421819:0:19477:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789185905.421859:0:19477:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789185905.421891:0:19477:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789185905.421957:0:19477:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789185905.422697:0:19477:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789185905.422964:0:19477:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789185906.086869:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789185906.455330:0:19543:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185906.455691:0:19543:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789185907.110160:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789185907.110974:0:17153:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789185907.110979:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f1c316e800 from 10 10000000:01000000:2.0:1789185907.110984:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789185907.111026:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402e600/0xda5c730d5a7429a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185907.111039:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c402e600/0xda5c730d5a7429a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185907.111050:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c402e600/0xda5c730d5a7429a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185907.111075:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898511104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185907.111141:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185907.111189:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300085900 going to sleep for 11 seconds 00000100:00100000:1.0:1789185907.111461:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898511104 00000100:00100000:1.0:1789185907.111470:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898511104 00000100:00100000:1.0:1789185907.111524:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789185907.111534:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:17153:x1876096898511104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185907.111548:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185907.111563:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2ff9c0400/0xda5c730d5a742a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a7429a expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185907.111587:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2ff9c0400/0xda5c730d5a742a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a7429a expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185907.111597:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2ff9c0400/0xda5c730d5a742a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7429a expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185907.111606:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0400, rc 0) 00000100:00100000:1.0:1789185907.111656:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898511104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185907.111663:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789185907.111781:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898511104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185907.111797:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c402e600/0xda5c730d5a7429a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a742a1 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185907.111806:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c402e600/0xda5c730d5a7429a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a742a1 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185907.111879:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898511232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789185907.111941:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185907.111969:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185907.112134:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898511232 00000100:00100000:1.0:1789185907.112147:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898511232 00000100:00100000:1.0:1789185907.112182:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789185907.112189:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898511232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789185907.112203:0:17149:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789185907.112219:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789185907.112221:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789185907.112301:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898511232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185907.112308:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789185907.112579:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898511232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789185907.112637:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789185907.112645:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402e600/0xda5c730d5a7429a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a742a1 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185907.112655:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c402e600/0xda5c730d5a7429a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a742a1 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185907.112664:0:17153:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789185907.112666:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98f1c41b6000 from 10 10000000:01000000:3.0:1789185907.112669:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789185907.112688:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a742a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185907.112695:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a742a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185907.112702:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a742a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185907.112715:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898511360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185907.112741:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185907.112766:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185907.112813:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898511360 00000100:00100000:2.0:1789185907.112818:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898511360 00000100:00100000:2.0:1789185907.112863:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789185907.112870:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898511360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185907.112879:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185907.112888:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402ee00/0xda5c730d5a742af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a742a8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185907.112939:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402ee00/0xda5c730d5a742af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a742a8 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185907.112948:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402ee00/0xda5c730d5a742af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a742a8 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185907.112956:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ee00, rc 0) 00000100:00100000:2.0:1789185907.112983:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:17153:x1876096898511360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185907.112989:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789185907.113114:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898511360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185907.113127:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a742a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a742af expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185907.113135:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a742a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a742af expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185907.113179:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898511488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789185907.113204:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185907.113229:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185907.113272:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898511488 00000100:00100000:2.0:1789185907.113277:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898511488 00000100:00100000:2.0:1789185907.113307:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789185907.113314:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:17153:x1876096898511488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789185907.113324:0:17150:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789185907.113336:0:17150:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789185907.113339:0:17150:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789185907.113403:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:17153:x1876096898511488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185907.113410:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789185907.113437:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898511488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789185907.113487:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789185907.113493:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a742a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a742af expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185907.113501:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30db800/0xda5c730d5a742a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a742af expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185908.134421:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185908.135556:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789185908.135578:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898511616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185908.135653:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185908.135705:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898511616 00000100:00100000:1.0:1789185908.135713:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898511616 00000100:00100000:1.0:1789185908.135766:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789185908.135775:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898511616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185908.135803:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789185908.135861:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898511616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185908.135869:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789185908.135947:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898511616:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789185908.139478:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185909.158120:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898511744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185909.158195:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185909.158305:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898511744 00000100:00100000:0.0:1789185909.158313:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898511744 00000100:00100000:0.0:1789185909.158370:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789185909.158380:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898511744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185909.158415:0:17161:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789185909.158461:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898511744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185909.158480:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789185909.158665:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898511872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185909.158695:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185909.158821:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898511744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789185909.159002:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898511872 00000100:00100000:2.0:1789185909.159007:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898511872 00000100:00100000:2.0:1789185909.159052:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789185909.159060:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898511872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185909.159075:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789185909.159112:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898511872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185909.159118:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789185909.159184:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898511872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789185909.159235:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789185909.162353:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789185909.610623:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789185909.671617:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789185909.671644:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898512000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185909.671718:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185909.671765:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898512000 00000100:00100000:2.0:1789185909.671773:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898512000 00000100:00100000:2.0:1789185909.671830:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789185909.671839:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898512000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185909.671872:0:17896:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789185909.671939:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898512000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185909.671946:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789185909.671993:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898512000:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185910.182183:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789185910.694274:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185910.694281:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789185910.694284:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185910.694301:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f2f2752000 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185910.694325:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f1c35e0000 x1876096898512512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789185910.694368:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789185910.694371:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789185910.694373:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789185910.694379:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f2c7c41800 using connection 192.168.204.148@tcp/0@lo 00000100:00100000:3.0:1789185910.694389:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f2f758e680 x1876096898513024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789185910.694443:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898512256:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.694521:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.694574:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898512896:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.694615:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.694632:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898513536:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.694654:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.694677:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789185910.694683:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898512128:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.694724:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.694745:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898512768:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.694768:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.694798:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898513408:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.694818:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.694844:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898512384:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.694866:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.694882:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898513152:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.694901:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.694943:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898513664:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.694963:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.694980:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789185910.694986:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898512640:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.695005:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.695014:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898513280:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.695045:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.695066:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898512512:0@lo:8:kworker.0 00000100:00100000:3.0:1789185910.695086:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.695103:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898513024:0@lo:8:kworker.0 00000100:00100000:3.0:1789185910.695133:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.695162:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898512256 00000100:00100000:3.0:1789185910.695170:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898512256 00000100:00100000:3.0:1789185910.695210:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898512768 00000100:00100000:3.0:1789185910.695213:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898512768 00000100:00100000:3.0:1789185910.695231:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789185910.695239:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898512256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.695291:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898512256:12345-0@lo:400:kworker.0 Request processed in 51us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.695298:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789185910.695316:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789185910.695323:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898512768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.695367:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898512768:12345-0@lo:400:kworker.0 Request processed in 44us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.695374:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789185910.695393:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898512896 00000100:00100000:3.0:1789185910.695397:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898512896 00000100:00100000:3.0:1789185910.695414:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898512384 00000100:00100000:3.0:1789185910.695418:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898512384 00000100:00100000:3.0:1789185910.695438:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898512512 00000100:00100000:3.0:1789185910.695441:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898512512 00000100:00100000:3.0:1789185910.695447:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898513024 00000100:00100000:3.0:1789185910.695450:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898513024 00000100:00100000:3.0:1789185910.695458:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185910.695464:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898512896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.695493:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898512896:12345-0@lo:400:kworker.0 Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.695499:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789185910.695519:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185910.695526:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898512384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.695557:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898512384:12345-0@lo:400:kworker.0 Request processed in 32us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.695563:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789185910.695574:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185910.695578:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898512512:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789185910.695605:0:18662:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:3.0:1789185910.695637:0:18662:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xda5c730d5a742b6 00002000:00100000:3.0:1789185910.695651:0:18662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98f1c30fa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789185910.695656:0:18662:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789185910.695659:0:18662:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789185910.695841:0:18662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789185910.695867:0:18662:0:(import.c:65:import_set_state_nolock()) ffff98f1c30f8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185910.695904:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1876096898512512:12345-0@lo:8:kworker.0 Request processed in 323us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.695938:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185910.695951:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185910.695955:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876096898513024:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789185910.695970:0:18662:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:3.0:1789185910.695986:0:18662:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xda5c730d5a742bd 00002000:00100000:3.0:1789185910.695992:0:18662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98f1c30fc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789185910.695995:0:18662:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789185910.695998:0:18662:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789185910.696018:0:18662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789185910.696036:0:18662:0:(import.c:65:import_set_state_nolock()) ffff98f1c30f9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789185910.696065:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876096898513024:12345-0@lo:8:kworker.0 Request processed in 108us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.696071:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789185910.696094:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898513536 00000100:00100000:3.0:1789185910.696098:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898513536 00000100:00100000:3.0:1789185910.696118:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898513408 00000100:00100000:3.0:1789185910.696121:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898513408 00000100:00100000:3.0:1789185910.696138:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898513152 00000100:00100000:3.0:1789185910.696141:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898513152 00000100:00100000:3.0:1789185910.696151:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898513664 00000100:00100000:3.0:1789185910.696153:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898513664 00000100:00100000:3.0:1789185910.696162:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898512640 00000100:00100000:3.0:1789185910.696164:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898512640 00000100:00100000:3.0:1789185910.696174:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898513280 00000100:00100000:3.0:1789185910.696176:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898513280 00000100:00100000:3.0:1789185910.696188:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185910.696194:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898513536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.696223:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898513536:12345-0@lo:400:kworker.0 Request processed in 29us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.696228:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789185910.696239:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185910.696244:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898513408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185910.696255:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789185910.696263:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898513152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.696268:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898513408:12345-0@lo:400:kworker.0 Request processed in 25us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.696273:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789185910.696284:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789185910.696289:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898513664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185910.696291:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876096898513152:12345-0@lo:400:kworker.0 Request processed in 30us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185910.696296:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789185910.696310:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876096898513664:12345-0@lo:400:kworker.0 Request processed in 22us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185910.696316:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789185910.696320:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789185910.696321:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898512640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.696331:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789185910.696335:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898513280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185910.696346:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876096898512640:12345-0@lo:400:kworker.0 Request processed in 25us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185910.696351:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789185910.696356:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876096898513280:12345-0@lo:400:kworker.0 Request processed in 21us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.696361:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789185910.696380:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898512128 00000100:00100000:1.0:1789185910.696384:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898512128 00000100:00100000:3.0:1789185910.696398:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898512768:0@lo:400:kworker.0 00000100:00100000:1.0:1789185910.696407:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00010000:00080000:3.0:1789185910.696410:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7495180 x1876096898513408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185910.696412:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3636:x1876096898512128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.696420:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898513408:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.696429:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898512256:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.696438:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898512896:0@lo:400:kworker.0 00000100:00100000:1.0:1789185910.696441:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3636:x1876096898512128:12345-0@lo:400:kworker.0 Request processed in 29us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185910.696446:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:3.0:1789185910.696447:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7496300 x1876096898513536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185910.696455:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898513536:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.696479:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898512128:0@lo:400:kworker.0 00000100:00080000:1.0:1789185910.696481:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185910.696484:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185910.696486:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789185910.696499:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e0e00 x1876096898512640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185910.696506:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876096898512640:0@lo:400:kworker.0 00010000:00080000:3.0:1789185910.696516:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7496a00 x1876096898513280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185910.696536:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876096898513280:0@lo:400:kworker.0 00000100:00100000:3.0:1789185910.696552:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898512384:0@lo:400:kworker.0 00010000:00080000:3.0:1789185910.696560:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7496d80 x1876096898513152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185910.696568:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876096898513152:0@lo:400:kworker.0 00010000:00080000:3.0:1789185910.696575:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7497b80 x1876096898513664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185910.696582:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876096898513664:0@lo:400:kworker.0 00010000:00080000:3.0:1789185910.696611:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c35e0000 x1876096898512512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789185910.696623:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789185910.696631:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789185910.696636:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789185910.696639:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2f2752000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789185910.696665:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789185910.696671:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876096898512512:0@lo:8:kworker.0 00010000:00080000:3.0:1789185910.696682:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f758e680 x1876096898513024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789185935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789185910.696690:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789185910.696695:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789185910.696698:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789185910.696700:0:3634:0:(import.c:65:import_set_state_nolock()) ffff98f2c7c41800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789185910.696717:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789185910.696721:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f758e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876096898513024:0@lo:8:kworker.0 00000004:00080000:3.0:1789185910.696782:0:17900:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789185910.696803:0:17900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7496d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17900:1876096898513920:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789185910.696832:0:17900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.696850:0:17900:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d12780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185910.696862:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898513792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185910.696884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.696945:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898513920 00000100:00100000:3.0:1789185910.696948:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898513920 00000100:00100000:3.0:1789185910.696975:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789185910.696981:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17900:x1876096898513920:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789185910.697266:0:17182:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789185910.697280:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17182:1876096898514176:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789185910.697306:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185910.697320:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c302ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185910.697333:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898514048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185910.697353:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185910.697400:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898513792 00000100:00100000:1.0:1789185910.697404:0:18666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898513792 00000100:00100000:1.0:1789185910.697421:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898514048 00000100:00100000:1.0:1789185910.697423:0:18666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898514048 00000100:00100000:1.0:1789185910.697438:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185910.697443:0:18666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1876096898513792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185910.697469:0:18666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789185910.697508:0:18666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1876096898513792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185910.697514:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789185910.697527:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789185910.697533:0:18666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898514048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185910.697543:0:18666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789185910.697589:0:18666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876096898514048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185910.697595:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789185910.697619:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c34b0380 x1876096898514048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185910.697633:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c34b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898514048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185910.697682:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898514176 00000100:00100000:1.0:1789185910.697685:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898514176 00000100:00100000:1.0:1789185910.697701:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185910.697707:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17182:x1876096898514176:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1789185910.697749:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789185910.698156:0:17181:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789185910.698233:0:17181:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 549860324242ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789185910.698240:0:17181:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789185910.698258:0:17899:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789185910.698309:0:17899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 549860399838ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789185910.698313:0:17899:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:3.0:1789185910.700582:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7497b80 x1876096898513792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789185926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185910.700610:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898513792:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1789185910.706102:0:17888:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1789185910.706146:0:17135:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789185910.710095:0:18662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789185910.710105:0:18662:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789185910.710198:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17900:x1876096898513920:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13213us (13361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.710210:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789185910.710246:0:17900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f7496d80 x1876096898513920/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789185926 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185910.710262:0:17900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7496d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17900:1876096898513920:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789185910.710276:0:17900:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789185910.710320:0:17900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17900:1876096898514304:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789185910.710358:0:17900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185910.710443:0:17900:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c302e240 going to sleep for 11 seconds 00002000:00080000:2.0:1789185910.712507:0:18663:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789185910.712519:0:18663:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789185910.712525:0:18663:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:3.0:1789185910.721497:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898514304 00000100:00100000:3.0:1789185910.721512:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898514304 00000100:00100000:3.0:1789185910.721590:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185910.721602:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17900:x1876096898514304:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789185910.721637:0:18664:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789185910.721720:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17900:x1876096898514304:12345-0@lo:5:osp-pre-1-1.0 Request processed in 119us (11360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185910.721736:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789185910.721809:0:17900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2f2bd8e00 x1876096898514304/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789185926 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789185910.721824:0:17900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17900:1876096898514304:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789185910.721836:0:17900:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789185910.721878:0:17900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17900:1876096898514432:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789185910.721931:0:17900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185910.721950:0:17900:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2d12780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185910.722034:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898514432 00000100:00100000:3.0:1789185910.722038:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898514432 00000100:00100000:3.0:1789185910.722062:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789185910.722068:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17900:x1876096898514432:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789185910.722090:0:18662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1789185910.727286:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.727301:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727318:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.727323:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.727330:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727347:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727357:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727366:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727388:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185910.727398:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185910.727403:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727418:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185910.727422:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727432:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727449:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727457:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a742c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.727475:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.727477:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.727479:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185910.729019:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.729030:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.729045:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.729049:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.729055:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.729068:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.729086:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.729094:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.729109:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185910.729935:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185910.729943:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.729953:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185910.729958:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.729968:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.729989:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.729996:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecd3b606/0xda5c730d5a742cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.731077:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.731079:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.731081:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185910.732232:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.732246:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.732263:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.732267:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.732274:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.732287:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.732299:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.732307:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.732354:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185910.732554:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185910.732561:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.732570:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185910.732574:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.732584:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.732604:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.732618:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000007143c7/0xda5c730d5a742d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.732636:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.732640:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.732641:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185910.734130:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.734141:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.734156:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.734159:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.734164:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.734177:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.734186:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.734193:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.734216:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185910.734284:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185910.734292:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.734301:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e200 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185910.734305:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.734329:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.734346:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.734354:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a742d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.734372:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.734374:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.734376:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185910.737130:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.737145:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.737165:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.737178:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.737185:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.737201:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.737212:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.737220:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.737249:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185910.737485:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185910.737492:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.737500:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402ec00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185910.737505:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.737514:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.737533:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.737550:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a742e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.737569:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.737571:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.737573:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789185910.739585:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789185910.739596:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.739611:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1789185910.739615:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185910.739621:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.739634:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.739644:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.739651:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.739680:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185910.739832:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185910.739839:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.739846:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8c00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185910.739850:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.739858:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.739874:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.739892:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff74e322/0xda5c730d5a742e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.739973:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.739975:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.739977:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.740369:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.740376:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740386:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.740389:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.740393:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740403:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740411:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740417:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740433:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185910.740441:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185910.740451:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740459:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dbe00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185910.740462:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740469:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740481:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740487:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096101774/0xda5c730d5a742ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.740501:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.740503:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.740506:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.741130:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.741138:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741147:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.741151:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.741156:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741178:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741187:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741194:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741211:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185910.741220:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185910.741225:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741233:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185910.741236:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741243:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741254:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741261:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c143cc2/0xda5c730d5a742f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741283:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.741285:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.741286:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.741584:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.741591:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741599:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.741602:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.741607:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741616:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741624:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741631:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741645:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185910.741651:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185910.741655:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741672:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30daa00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185910.741675:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741683:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741695:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741702:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8993b73/0xda5c730d5a742fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.741716:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.741717:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.741719:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.742091:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.742097:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742106:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.742109:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.742113:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742122:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742137:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742144:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742155:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789185910.742162:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185910.742165:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742172:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dac00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185910.742175:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742182:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742193:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742200:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c77712f8/0xda5c730d5a74303 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742213:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.742219:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.742221:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.742457:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.742463:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742471:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.742474:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.742477:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742486:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742495:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742501:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.742522:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789185910.743110:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.743118:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743126:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.743130:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.743134:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743152:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743160:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743166:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743180:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789185910.743190:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185910.743195:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743201:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185910.743204:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743211:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743224:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743231:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b01dd734/0xda5c730d5a7430a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743253:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185910.743257:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743263:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185910.743266:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743273:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743282:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743288:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000588c98d5/0xda5c730d5a74311 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.743298:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.743300:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185910.743301:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.745318:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.745332:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.745348:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.745352:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.745365:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.745380:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.745390:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.745398:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.746994:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185910.747070:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185910.747087:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.747105:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185910.747110:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.747122:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.747152:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.747162:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000268e03d2/0xda5c730d5a74318 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.747187:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.747189:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.747191:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.752066:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.752083:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.752102:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.752106:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.752113:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.752128:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.752139:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.752161:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.752188:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185910.752819:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185910.752827:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.752836:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185910.752841:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.752850:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.752868:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.752875:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014dae5ea/0xda5c730d5a7431f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.752895:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.752897:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.752899:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185910.753416:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.753424:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.753435:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.753438:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.753443:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.753453:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.753461:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.753469:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.753493:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185910.753629:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185910.753635:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.753644:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185910.753647:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.753668:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.753681:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.753689:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74326 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.753706:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.753708:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.753711:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185910.754381:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.754389:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.754399:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.754402:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.754406:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.754428:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.754436:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.754443:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.754466:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185910.754586:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185910.754592:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.754599:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fa00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185910.754603:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.754610:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.754623:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.754643:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7432d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.754657:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.754659:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.754660:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.755149:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.755655:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.755665:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.755678:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.755681:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.755686:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.755697:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.755706:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.755713:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.755737:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789185910.756080:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.756086:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756099:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.756101:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.756105:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756114:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756121:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756128:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756143:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789185910.756176:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789185910.756183:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756191:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dba00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185910.756195:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756204:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756219:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756227:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab99809d/0xda5c730d5a74334 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756251:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185910.756255:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756262:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db200 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185910.756265:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756272:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756282:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756289:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dee6d62/0xda5c730d5a7433b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756299:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.756300:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.756302:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.756414:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.756420:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756428:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.756431:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.756436:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756445:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756464:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756471:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.756490:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789185910.756798:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789185910.756804:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756812:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185910.756821:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756829:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756841:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756848:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c06ece8d/0xda5c730d5a74342 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.756864:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.756866:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185910.756867:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.757146:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789185910.757261:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789185910.757268:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.757277:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=549s v=(0 0) 00010000:00010000:3.0:1789185910.757280:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789185910.757284:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.757292:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.757299:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.757305:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185910.757338:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185910.757614:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185910.757620:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757628:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185910.757639:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757647:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757662:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757669:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5173ee4/0xda5c730d5a74349 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757689:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.757692:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.757694:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185910.757845:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789185910.757852:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757860:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1789185910.757864:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185910.757868:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757878:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757886:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757898:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.757936:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185910.758041:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185910.758046:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758054:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031600 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185910.758058:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758066:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758077:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758084:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008344c44b/0xda5c730d5a74350 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758099:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.758101:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.758103:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185910.758329:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789185910.758336:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758351:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1789185910.758355:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185910.758359:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758369:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758377:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758385:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758398:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185910.758407:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185910.758411:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758418:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030200 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185910.758422:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758430:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758453:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758459:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dda7178/0xda5c730d5a74357 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.758476:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.758479:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.758481:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789185910.759102:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789185910.759109:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.759119:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1789185910.759122:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185910.759126:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.759136:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.759144:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.759152:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.759177:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185910.764331:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185910.764343:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.764356:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185910.764361:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.764372:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.764392:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.764400:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e4a1154/0xda5c730d5a7435e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.764420:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.764422:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.764424:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789185910.767041:0:19478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789185910.767081:0:19478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789185910.767086:0:19478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789185910.772133:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17900:x1876096898514432:12345-0@lo:5:osp-pre-1-1.0 Request processed in 50054us (50190us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789185910.772150:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789185910.772227:0:17900:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789185910.772241:0:17900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f7497b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17900:1876096898514432:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789185910.772261:0:17900:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789185910.772318:0:17900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17900:1876096898514560:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789185910.772361:0:17900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185910.772385:0:17900:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2db3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789185910.772417:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898514560 00000100:00100000:0.0:1789185910.772424:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898514560 00000100:00100000:0.0:1789185910.772463:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789185910.772472:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17900:x1876096898514560:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789185910.772522:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17900:x1876096898514560:12345-0@lo:900:osp-pre-1-1.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185910.772529:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789185910.772559:0:17900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c4157480 x1876096898514560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789185926 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185910.772569:0:17900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4157480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17900:1876096898514560:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1789185910.775851:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.775867:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.775884:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.775888:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.775895:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.775937:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.775949:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.775972:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.775988:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789185910.776447:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185910.776455:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.776477:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e800 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185910.776482:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.776493:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.776511:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.776518:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f3fa770/0xda5c730d5a74365 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.776535:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.776536:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.776538:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185910.776756:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.776762:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778014:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.778019:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.778027:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778042:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778052:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778059:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778084:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789185910.778469:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.778476:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778490:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.778493:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.778497:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778507:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778514:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778521:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.778541:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789185910.779102:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789185910.779111:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779120:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fa00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185910.779125:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779134:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779158:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779165:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000007d2e1c/0xda5c730d5a7436c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779183:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789185910.779187:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779194:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e400 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:0.0:1789185910.779197:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779205:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779215:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779222:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa0beece/0xda5c730d5a74373 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185910.779233:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.779235:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789185910.779242:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.779478:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185910.780040:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.780049:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.780060:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.780063:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.780069:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.780079:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.780099:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.780106:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.780121:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789185910.780684:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185910.780692:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.780702:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402ec00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185910.780707:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.780717:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.780745:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.780753:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a30ecac5/0xda5c730d5a7437a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.780779:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.780781:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.780782:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789185910.781024:0:18663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789185910.781031:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.781040:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1789185910.781044:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185910.781048:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.781057:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.781065:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.781072:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185910.781103:0:18663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789185910.781142:0:18663:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1789185910.781225:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17182:x1876096898514176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 83514us (83914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185910.781235:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789185910.781514:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185910.781520:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.781541:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402e200 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185910.781544:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.781552:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.781564:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.781570:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea4fc32/0xda5c730d5a74381 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185910.781584:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.781586:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185910.781588:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185910.781624:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17182:1876096898514176:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789185910.781638:0:17182:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789185910.781681:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17182:1876096898514688:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789185910.781716:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185910.781755:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c302ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185910.785285:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898514688 00000100:00100000:3.0:1789185910.785301:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898514688 00000100:00100000:3.0:1789185910.785378:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185910.785389:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17182:x1876096898514688:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789185910.785437:0:18664:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1789185910.791967:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17182:x1876096898514688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6574us (10243us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789185910.791980:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789185910.793292:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17182:1876096898514688:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789185910.793312:0:17182:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1789185911.210218:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789185912.160723:0:19833:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg448-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789185912.230018:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185913.255090:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185913.255206:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185913.255227:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898514816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185913.255304:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185913.255424:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898514816 00000100:00100000:1.0:1789185913.255432:0:18666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898514816 00000100:00100000:1.0:1789185913.255492:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185913.255501:0:18666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898514816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185913.255528:0:18666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789185913.255573:0:18666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898514816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185913.255580:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789185913.255630:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898514816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789185913.255739:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1789185913.270827:0:19885:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185913.271214:0:19885:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1789185914.090502:0:19935:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789185914.090774:0:19935:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789185914.278407:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789185914.278432:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898514944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185914.278506:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185914.278971:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898514944 00000100:00100000:1.0:1789185914.278979:0:18666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898514944 00000100:00100000:1.0:1789185914.279051:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789185914.279061:0:18666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898514944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185914.279084:0:18666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789185914.279136:0:18666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898514944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185914.279144:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789185914.279201:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185914.279236:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898514944:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789185914.279407:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185914.279781:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789185914.279794:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2c87b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898515072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185914.279834:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185914.280143:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898515072 00000100:00100000:0.0:1789185914.280149:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898515072 00000100:00100000:0.0:1789185914.280192:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789185914.280200:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898515072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185914.280230:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789185914.280277:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898515072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185914.280285:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789185914.280358:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2c87b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898515072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185914.392271:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185914.395101:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879546368 00000100:00100000:1.0:1789185914.395118:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879546368 00000100:00100000:1.0:1789185914.395244:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 116 00000100:00100000:1.0:1789185914.395254:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2388:x1876096879546368:12345-192.168.204.48@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789185914.395297:0:17149:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from aef2505e-7927-4768-ad72-37facf71ba21@192.168.204.48@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:1.0:1789185914.395341:0:17149:0:(genops.c:1384:class_connect()) connect: client aef2505e-7927-4768-ad72-37facf71ba21, cookie 0xda5c730d5a74388 00000100:00080000:1.0:1789185914.395489:0:17149:0:(import.c:65:import_set_state_nolock()) ffff98f1c2c6a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789185914.395602:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+5:2388:x1876096879546368:12345-192.168.204.48@tcp:250:mount.lustre.0 Request processed in 349us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185914.395610:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 116 00000100:00100000:1.0:1789185914.401752:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185914.402009:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879546496 00000100:00100000:3.0:1789185914.402019:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879546496 00000100:00100000:3.0:1789185914.402083:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 117 00000100:00100000:3.0:1789185914.402095:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+5:14887:x1876096879546496:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789185914.402111:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185914.402131:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30da400/0xda5c730d5a7438f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee521b3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185914.402161:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30da400/0xda5c730d5a7438f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521b3 expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185914.402172:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30da400/0xda5c730d5a7438f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521b3 expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185914.402197:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30da400, rc 0) 00000100:00100000:3.0:1789185914.402264:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+6:14887:x1876096879546496:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 172us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185914.402280:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 117 00000100:00100000:3.0:1789185914.408670:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185914.408957:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879546624 00000100:00100000:1.0:1789185914.408969:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879546624 00000100:00100000:1.0:1789185914.409028:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 118 00000100:00100000:1.0:1789185914.409039:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+6:14887:x1876096879546624:12345-192.168.204.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789185914.409176:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+6:14887:x1876096879546624:12345-192.168.204.48@tcp:501:mount.lustre.0 Request processed in 138us (516us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789185914.409184:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 118 00000100:00100000:0.0:1789185914.415100:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185914.419337:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879546752 00000100:00100000:2.0:1789185914.419354:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879546752 00000100:00100000:2.0:1789185914.419428:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 119 00000100:00100000:2.0:1789185914.419438:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+6:14887:x1876096879546752:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789185914.419455:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185914.419472:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402ec00/0xda5c730d5a74396 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee521ba expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185914.419500:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402ec00/0xda5c730d5a74396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521ba expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185914.419511:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402ec00/0xda5c730d5a74396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521ba expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185914.419520:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402ec00, rc 0) 00000100:00100000:2.0:1789185914.420445:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+7:14887:x1876096879546752:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 1001us (5348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.420455:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 119 00000100:00100000:2.0:1789185914.434432:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185914.434539:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879546880 00000100:00100000:3.0:1789185914.434549:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879546880 00000100:00100000:3.0:1789185914.434615:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 120 00000100:00100000:3.0:1789185914.434625:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+7:14887:x1876096879546880:12345-192.168.204.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789185914.434803:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+8:14887:x1876096879546880:12345-192.168.204.48@tcp:501:mount.lustre.0 Request processed in 179us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185914.434812:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 120 00000100:00100000:3.0:1789185914.437080:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185914.437188:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879547008 00000100:00100000:2.0:1789185914.437199:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879547008 00000100:00100000:2.0:1789185914.437291:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 121 00000100:00100000:2.0:1789185914.437303:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f3003ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+8:14887:x1876096879547008:12345-192.168.204.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789185914.437458:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f3003ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+8:14887:x1876096879547008:12345-192.168.204.48@tcp:503:mount.lustre.0 Request processed in 156us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.437466:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 121 00000100:00100000:0.0:1789185914.443493:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185914.443942:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879547136 00000100:00100000:1.0:1789185914.443955:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879547136 00000100:00100000:1.0:1789185914.444017:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 122 00000100:00100000:1.0:1789185914.444027:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+8:14906:x1876096879547136:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185914.444201:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+8:14906:x1876096879547136:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 174us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185914.444209:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 122 00000100:00100000:1.0:1789185914.491072:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185914.491296:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879547264 00000100:00100000:2.0:1789185914.491307:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879547264 00000100:00100000:2.0:1789185914.491365:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 123 00000100:00100000:2.0:1789185914.491375:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+8:14906:x1876096879547264:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789185914.491538:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+8:14906:x1876096879547264:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 162us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.491546:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 123 00000100:00100000:2.0:1789185914.497120:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185914.497432:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879547392 00000100:00100000:3.0:1789185914.497443:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879547392 00000100:00100000:3.0:1789185914.497500:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 124 00000100:00100000:3.0:1789185914.497510:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+8:14906:x1876096879547392:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789185914.497896:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+8:14906:x1876096879547392:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 386us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185914.497904:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 124 00000100:00100000:0.0:1789185914.506050:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185914.511103:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879547520 00000100:00100000:2.0:1789185914.511118:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879547520 00000100:00100000:2.0:1789185914.511207:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 125 00000100:00100000:2.0:1789185914.511218:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+8:14887:x1876096879547520:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789185914.511234:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185914.511256:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402e800/0xda5c730d5a7439d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee521eb expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185914.511283:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402e800/0xda5c730d5a7439d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521eb expref: 9 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185914.511314:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402e800/0xda5c730d5a7439d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521eb expref: 9 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185914.511324:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e800, rc 0) 00000100:00100000:2.0:1789185914.511405:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+9:14887:x1876096879547520:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 189us (5363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.511412:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 125 00000100:00100000:2.0:1789185914.514601:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185914.514770:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879547648 00000100:00100000:1.0:1789185914.514781:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879547648 00000100:00100000:1.0:1789185914.514839:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 126 00000100:00100000:1.0:1789185914.514849:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+9:14887:x1876096879547648:12345-192.168.204.48@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789185914.514873:0:17149:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789185914.514897:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789185914.514902:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789185914.514939:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789185914.514942:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789185914.514945:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789185914.518489:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+9:14887:x1876096879547648:12345-192.168.204.48@tcp:256:mount.lustre.0 Request processed in 3631us (3887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185914.518505:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 126 00000100:00100000:0.0:1789185914.529780:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185914.531178:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879547776 00000100:00100000:2.0:1789185914.531193:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879547776 00000100:00100000:2.0:1789185914.531261:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 127 00000100:00100000:2.0:1789185914.531272:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+9:14887:x1876096879547776:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789185914.531356:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185914.531375:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee521f2 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185914.531407:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521f2 expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185914.531419:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521f2 expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185914.531428:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402fa00, rc 0) 00000100:00100000:2.0:1789185914.531687:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+10:14887:x1876096879547776:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 416us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.531695:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 127 00000100:00100000:2.0:1789185914.535582:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185914.535859:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879547904 00000100:00100000:1.0:1789185914.535870:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879547904 00000100:00100000:1.0:1789185914.536011:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 128 00000100:00100000:1.0:1789185914.536023:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+10:14887:x1876096879547904:12345-192.168.204.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789185914.536210:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+10:14887:x1876096879547904:12345-192.168.204.48@tcp:501:mount.lustre.0 Request processed in 189us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185914.536218:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 128 00000100:00100000:3.0:1789185914.546077:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185914.546353:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879548032 00000100:00100000:2.0:1789185914.546364:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879548032 00000100:00100000:2.0:1789185914.546427:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 129 00000100:00100000:2.0:1789185914.546439:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+10:14887:x1876096879548032:12345-192.168.204.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789185914.546617:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+10:14887:x1876096879548032:12345-192.168.204.48@tcp:503:mount.lustre.0 Request processed in 180us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.546624:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 129 00000100:00100000:0.0:1789185914.554157:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185914.554281:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879548160 00000100:00100000:1.0:1789185914.554292:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879548160 00000100:00100000:1.0:1789185914.554414:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 130 00000100:00100000:1.0:1789185914.554425:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+10:14910:x1876096879548160:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185914.554585:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+10:14910:x1876096879548160:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 161us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185914.554593:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 130 00000100:00100000:1.0:1789185914.564043:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185914.564147:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879548288 00000100:00100000:3.0:1789185914.564158:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879548288 00000100:00100000:3.0:1789185914.564232:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 131 00000100:00100000:3.0:1789185914.564243:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+10:14910:x1876096879548288:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789185914.564647:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+10:14910:x1876096879548288:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 405us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185914.564655:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 131 00000100:00100000:3.0:1789185914.582081:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185914.582196:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185914.582300:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879548416 00000100:00100000:2.0:1789185914.582311:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879548416 00000100:00100000:2.0:1789185914.582355:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879548672 00000100:00100000:2.0:1789185914.582359:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879548672 00000100:00100000:2.0:1789185914.582402:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:2.0:1789185914.582411:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1876096879548416:12345-192.168.204.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789185914.582443:0:18686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8e5c6ede-0048-44ff-85dd-b5867120aa40@192.168.204.48@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1789185914.582500:0:18686:0:(genops.c:1384:class_connect()) connect: client 8e5c6ede-0048-44ff-85dd-b5867120aa40, cookie 0xda5c730d5a743ab 00000004:00100000:2.0:1789185914.582524:0:18686:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789185914.582740:0:18686:0:(import.c:65:import_set_state_nolock()) ffff98f1c4394800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185914.582819:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2388:x1876096879548416:12345-192.168.204.48@tcp:38:mount.lustre.0 Request processed in 407us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.582826:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:2.0:1789185914.582850:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:2.0:1789185914.582854:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1876096879548672:12345-192.168.204.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789185914.582869:0:18686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 8e5c6ede-0048-44ff-85dd-b5867120aa40@192.168.204.48@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1789185914.582898:0:18686:0:(genops.c:1384:class_connect()) connect: client 8e5c6ede-0048-44ff-85dd-b5867120aa40, cookie 0xda5c730d5a743b2 00000004:00100000:2.0:1789185914.582943:0:18686:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789185914.583091:0:18686:0:(import.c:65:import_set_state_nolock()) ffff98f1c4393000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185914.583117:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2388:x1876096879548672:12345-192.168.204.48@tcp:38:mount.lustre.0 Request processed in 261us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.583125:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:0.0:1789185914.596574:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185914.596620:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185914.596730:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185914.596894:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879548800 00000100:00100000:3.0:1789185914.596942:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879548800 00000100:00100000:3.0:1789185914.597006:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879548544 00000100:00100000:3.0:1789185914.597010:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879548544 00000100:00100000:3.0:1789185914.597026:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879548928 00000100:00100000:3.0:1789185914.597028:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879548928 00000100:00100000:3.0:1789185914.597048:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:3.0:1789185914.597057:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:0:x1876096879548800:12345-192.168.204.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789185914.597096:0:17156:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789185914.597188:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:0:x1876096879548800:12345-192.168.204.48@tcp:41:mount.lustre.0 Request processed in 131us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185914.597196:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:3.0:1789185914.597213:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:3.0:1789185914.597220:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c87b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:0:x1876096879548544:12345-192.168.204.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789185914.597233:0:17156:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789185914.597271:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c87b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:0:x1876096879548544:12345-192.168.204.48@tcp:41:mount.lustre.0 Request processed in 51us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185914.597278:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:3.0:1789185914.597289:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00100000:3.0:1789185914.597296:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14887:x1876096879548928:12345-192.168.204.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789185914.597318:0:17156:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789185914.597344:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14887:x1876096879548928:12345-192.168.204.48@tcp:41:mount.lustre.0 Request processed in 47us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185914.597351:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00080000:0.0:1789185914.597587:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185914.597591:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185914.603444:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185914.603583:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879549056 00000100:00100000:3.0:1789185914.603593:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879549056 00000100:00100000:3.0:1789185914.603657:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:3.0:1789185914.603668:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14887:x1876096879549056:12345-192.168.204.48@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789185914.603771:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14887:x1876096879549056:12345-192.168.204.48@tcp:40:mount.lustre.0 Request processed in 104us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185914.603779:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:3.0:1789185914.611170:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185914.611224:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185914.611262:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185914.611379:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879549184 00000100:00100000:2.0:1789185914.611391:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879549184 00000100:00100000:2.0:1789185914.611432:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879549312 00000100:00100000:2.0:1789185914.611434:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879549312 00000100:00100000:2.0:1789185914.611452:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:2.0:1789185914.611459:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2388:x1876096879549184:12345-192.168.204.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789185914.611499:0:18662:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8e5c6ede-0048-44ff-85dd-b5867120aa40@192.168.204.48@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1789185914.611534:0:18662:0:(genops.c:1384:class_connect()) connect: client 8e5c6ede-0048-44ff-85dd-b5867120aa40, cookie 0xda5c730d5a743b9 00002000:00100000:2.0:1789185914.611545:0:18662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8e5c6ede-0048-44ff-85dd-b5867120aa40/ffff98f1c4395000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789185914.611556:0:18662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789185914.611883:0:18662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789185914.611950:0:18662:0:(import.c:65:import_set_state_nolock()) ffff98f1c4395800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185914.612011:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2388:x1876096879549184:12345-192.168.204.48@tcp:8:mount.lustre.0 Request processed in 550us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.612018:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:2.0:1789185914.612039:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:2.0:1789185914.612043:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2388:x1876096879549312:12345-192.168.204.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789185914.612060:0:18662:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8e5c6ede-0048-44ff-85dd-b5867120aa40@192.168.204.48@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1789185914.612077:0:18662:0:(genops.c:1384:class_connect()) connect: client 8e5c6ede-0048-44ff-85dd-b5867120aa40, cookie 0xda5c730d5a743c0 00002000:00100000:2.0:1789185914.612083:0:18662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8e5c6ede-0048-44ff-85dd-b5867120aa40/ffff98f1c4392800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789185914.612094:0:18662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789185914.612212:0:18662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789185914.612230:0:18662:0:(import.c:65:import_set_state_nolock()) ffff98f1c4397800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789185914.612253:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2388:x1876096879549312:12345-192.168.204.48@tcp:8:mount.lustre.0 Request processed in 208us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.612260:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:0.0:1789185914.612339:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879549440 00000100:00100000:0.0:1789185914.612345:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879549440 00000100:00100000:0.0:1789185914.612388:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:0.0:1789185914.612396:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f758e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14887:x1876096879549440:12345-192.168.204.48@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789185914.612432:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f758e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14887:x1876096879549440:12345-192.168.204.48@tcp:900:mount.lustre.0 Request processed in 39us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185914.612438:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:0.0:1789185914.624015:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185914.624115:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879549568 00000100:00100000:2.0:1789185914.624124:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879549568 00000100:00100000:2.0:1789185914.624175:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:2.0:1789185914.624185:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14887:x1876096879549568:12345-192.168.204.48@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789185914.626857:0:17158:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2587us 00000004:00200000:0.0:1789185914.653558:0:17158:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789185914.653720:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14887:x1876096879549568:12345-192.168.204.48@tcp:33:mount.lustre.0 Request processed in 29510us (29688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185914.653736:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:3.0:1789185914.790779:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185914.790805:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898515200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789185914.790884:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185914.791052:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898515200 00000100:00100000:2.0:1789185914.791061:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898515200 00000100:00100000:2.0:1789185914.791123:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789185914.791132:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898515200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185914.791162:0:17161:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789185914.791318:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898515200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 186us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185914.791326:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789185914.792682:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898515200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185914.962738:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185914.963987:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879549696 00000100:00100000:0.0:1789185914.963999:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879549696 00000100:00100000:0.0:1789185914.964060:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:0.0:1789185914.964070:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14933:x1876096879549696:12345-192.168.204.48@tcp:101:mkdir.0 00010000:00010000:0.0:1789185914.964089:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185914.964113:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a743c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52223 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185914.964176:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a743ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185914.964189:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a743ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185914.964220:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a743ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185914.964267:0:17157:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789185914.964272:0:17157:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789185914.965017:0:17157:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a743ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185914.965052:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a743c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52223 expref: 8 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185914.965072:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a743ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52223 expref: 7 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185914.965080:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2c4f8dd00) 00010000:00010000:0.0:1789185914.965083:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789185914.965087:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031a00, rc 0) 00000100:00100000:0.0:1789185914.965217:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:14933:x1876096879549696:12345-192.168.204.48@tcp:101:mkdir.0 Request processed in 1147us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185914.965225:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 13 00010000:00010000:1.0:1789185915.302231:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185915.495202:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789185915.816188:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898515328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185915.816257:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.816480:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898515840:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.816511:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.816528:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898516352:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.816546:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.816559:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898516864:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.816576:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.816593:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789185915.816598:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898515712:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.816618:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.816647:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898516224:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.816667:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.816697:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898516736:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.816719:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.816745:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898515712 00000100:00100000:2.0:1789185915.816752:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898515712 00000100:00100000:2.0:1789185915.816801:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898516224 00000100:00100000:2.0:1789185915.816804:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898516224 00000100:00100000:2.0:1789185915.816839:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789185915.816848:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898515712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.816894:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898515328 00000100:00100000:2.0:1789185915.816895:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898515712:12345-0@lo:400:kworker.0 Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185915.816898:0:18666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898515328 00000100:00100000:2.0:1789185915.816901:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789185915.816935:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789185915.816941:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898516224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.816942:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789185915.816947:0:18666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876096898515328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789185915.816959:0:18666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789185915.816966:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898516224:12345-0@lo:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185915.816971:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789185915.816986:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185915.816987:0:18666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876096898515328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (731us total) trans 0 rc 0/0 00000100:00080000:2.0:1789185915.816990:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185915.816993:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789185915.816998:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898515840 00000100:00100000:2.0:1789185915.817001:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898515840 00000100:00100000:1.0:1789185915.817008:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898515584:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.817017:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898516352 00000100:00100000:2.0:1789185915.817019:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898516352 00000100:00100000:2.0:1789185915.817028:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898516864 00000100:00100000:2.0:1789185915.817030:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898516864 00000100:00100000:1.0:1789185915.817033:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.817045:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898516736 00000100:00100000:2.0:1789185915.817047:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898516736 00000100:00100000:2.0:1789185915.817059:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789185915.817060:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898516096:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.817071:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898515840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.817079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185915.817092:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898516608:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.817098:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876096898515840:12345-0@lo:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185915.817104:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789185915.817109:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.817114:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898516608 00000100:00100000:2.0:1789185915.817116:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898516608 00000100:00100000:1.0:1789185915.817119:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789185915.817124:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898515456:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.817129:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789185915.817133:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898516352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.817148:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.817155:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876096898516352:12345-0@lo:400:kworker.0 Request processed in 21us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185915.817161:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789185915.817167:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898515968:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.817171:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789185915.817175:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898516864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.817186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.817196:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876096898516864:12345-0@lo:400:kworker.0 Request processed in 21us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185915.817199:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898516480:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.817202:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789185915.817211:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789185915.817216:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185915.817217:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898516736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.817234:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898516480 00000100:00100000:1.0:1789185915.817238:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898516480 00000100:00100000:2.0:1789185915.817239:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898516736:12345-0@lo:400:kworker.0 Request processed in 22us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185915.817243:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789185915.817253:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789185915.817257:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898516608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185915.817301:0:19112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898516096 00000100:00100000:3.0:1789185915.817305:0:19112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898516096 00000100:00100000:3.0:1789185915.817324:0:19112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185915.817330:0:19112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898516096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185915.817368:0:19112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898516096:12345-0@lo:400:kworker.0 Request processed in 38us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185915.817380:0:19112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789185915.817418:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898516096:0@lo:400:kworker.0 00000100:00100000:2.0:1789185915.817490:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876096898516608:12345-0@lo:400:kworker.0 Request processed in 231us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185915.817995:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898515584 00000100:00100000:0.0:1789185915.818000:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898515584 00000100:00100000:0.0:1789185915.818029:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898515968 00000100:00100000:0.0:1789185915.818032:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898515968 00000100:00100000:0.0:1789185915.818045:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789185915.818052:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898515584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185915.818090:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898515584:12345-0@lo:400:kworker.0 Request processed in 39us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185915.818107:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789185915.818122:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185915.818128:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898515968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185915.818154:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898515968:12345-0@lo:400:kworker.0 Request processed in 26us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185915.818159:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789185915.818223:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898515456 00000100:00100000:0.0:1789185915.818226:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898515456 00000100:00100000:0.0:1789185915.818249:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789185915.818255:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3638:x1876096898515456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185915.818283:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3638:x1876096898515456:12345-0@lo:400:kworker.0 Request processed in 28us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185915.818288:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1789185915.818326:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789185915.818330:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185915.818358:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898515712:0@lo:400:kworker.0 00000100:00100000:0.0:1789185915.818369:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898516224:0@lo:400:kworker.0 00000100:00100000:0.0:1789185915.818385:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898516736:0@lo:400:kworker.0 00000100:00100000:0.0:1789185915.818397:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876096898515840:0@lo:400:kworker.0 00000100:00100000:0.0:1789185915.818407:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876096898516352:0@lo:400:kworker.0 00010000:00080000:0.0:1789185915.818422:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33ec700 x1876096898516864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185915.818432:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876096898516864:0@lo:400:kworker.0 00000100:00100000:0.0:1789185915.818460:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c35e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898515328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789185915.818559:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789185915.818571:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898516480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.818603:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898516480:12345-0@lo:400:kworker.0 Request processed in 36us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185915.818615:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789185915.818653:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898515456:0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.818663:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898515968:0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.818684:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898516480:0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.818695:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898515584:0@lo:400:kworker.0 00010000:00080000:1.0:1789185915.818706:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c33eed80 x1876096898516608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185915.818716:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c33eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876096898516608:0@lo:400:kworker.0 00000100:00100000:1.0:1789185915.818731:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789185915.818741:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898516992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185915.818769:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185915.818798:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898516992 00000100:00100000:1.0:1789185915.818802:0:18666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898516992 00000100:00100000:1.0:1789185915.818825:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789185915.818832:0:18666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898516992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185915.818844:0:18666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789185915.818875:0:18666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898516992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185915.818881:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789185915.818929:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898516992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789185915.823414:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1789185916.326068:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789185916.846292:0:19478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8e5c6ede-0048-44ff-85dd-b5867120aa40 00000001:00080000:3.0:1789185916.846321:0:19478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:3.0:1789185916.901378:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185916.901577:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879549824 00000100:00100000:1.0:1789185916.901592:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879549824 00000100:00100000:1.0:1789185916.901726:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:1.0:1789185916.901740:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:14985:x1876096879549824:12345-192.168.204.48@tcp:41:lfs.0 00000004:00000024:1.0:1789185916.901795:0:17155:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789185916.901973:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:14985:x1876096879549824:12345-192.168.204.48@tcp:41:lfs.0 Request processed in 236us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185916.901982:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00080000:0.0:1789185916.902221:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185916.904549:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185916.906680:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879549952 00000100:00100000:2.0:1789185916.906700:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879549952 00000100:00100000:2.0:1789185916.906841:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:2.0:1789185916.906854:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14985:x1876096879549952:12345-192.168.204.48@tcp:41:lfs.0 00000004:00000024:2.0:1789185916.906931:0:17157:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1789185916.907267:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185916.907404:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14985:x1876096879549952:12345-192.168.204.48@tcp:41:lfs.0 Request processed in 551us (2868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185916.907414:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:2.0:1789185916.915246:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185916.915415:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879550080 00000100:00100000:1.0:1789185916.915429:0:18666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879550080 00000100:00100000:1.0:1789185916.915532:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00100000:1.0:1789185916.915545:0:18666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14985:x1876096879550080:12345-192.168.204.48@tcp:13:lfs.0 00002000:00000024:1.0:1789185916.915594:0:18666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789185916.915716:0:18666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:14985:x1876096879550080:12345-192.168.204.48@tcp:13:lfs.0 Request processed in 174us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185916.915724:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00080000:0.0:1789185916.916033:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185916.922365:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185916.927254:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879550208 00000100:00100000:1.0:1789185916.927281:0:18666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879550208 00000100:00100000:1.0:1789185916.927494:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:1.0:1789185916.927508:0:18666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c35e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:14985:x1876096879550208:12345-192.168.204.48@tcp:13:lfs.0 00002000:00000024:1.0:1789185916.927561:0:18666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789185916.928055:0:18666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c35e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:14985:x1876096879550208:12345-192.168.204.48@tcp:13:lfs.0 Request processed in 548us (5702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185916.928067:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00080000:0.0:1789185916.930166:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185917.115091:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185917.115512:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879550336 00000100:00100000:1.0:1789185917.115529:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879550336 00000100:00100000:1.0:1789185917.115612:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 133 00000100:00100000:1.0:1789185917.115626:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+10:15017:x1876096879550336:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789185917.115678:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185917.115707:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf9400/0xda5c730d5a743d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5222a expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.115766:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf9400/0xda5c730d5a743d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5222a expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.115782:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf9400/0xda5c730d5a743d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5222a expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.115793:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9400, rc 0) 00000100:00100000:1.0:1789185917.115885:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+11:15017:x1876096879550336:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 261us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185917.115893:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 133 00000100:00100000:2.0:1789185917.138035:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185917.138871:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879550464 00000100:00100000:1.0:1789185917.138888:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879550464 00000100:00100000:1.0:1789185917.139012:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 134 00000100:00100000:1.0:1789185917.139025:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+11:15017:x1876096879550464:12345-192.168.204.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789185917.139278:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+11:15017:x1876096879550464:12345-192.168.204.48@tcp:501:mount.lustre.0 Request processed in 252us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185917.139287:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 134 00000100:00100000:3.0:1789185917.145537:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185917.145770:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879550592 00000100:00100000:0.0:1789185917.145786:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879550592 00000100:00100000:0.0:1789185917.145868:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 135 00000100:00100000:0.0:1789185917.145882:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+11:15017:x1876096879550592:12345-192.168.204.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789185917.146150:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+11:15017:x1876096879550592:12345-192.168.204.48@tcp:503:mount.lustre.0 Request processed in 271us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.147123:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 135 00000100:00100000:0.0:1789185917.161792:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185917.162644:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879550720 00000100:00100000:3.0:1789185917.162672:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879550720 00000100:00100000:3.0:1789185917.162744:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 136 00000100:00100000:3.0:1789185917.162755:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+11:15024:x1876096879550720:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789185917.166424:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+11:15024:x1876096879550720:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 3650us (4630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185917.166442:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 136 00000100:00100000:2.0:1789185917.199490:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185917.199959:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879550848 00000100:00100000:1.0:1789185917.199973:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879550848 00000100:00100000:1.0:1789185917.200099:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 137 00000100:00100000:1.0:1789185917.200113:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+11:15024:x1876096879550848:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185917.200352:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+11:15024:x1876096879550848:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 242us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185917.200368:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 137 00000100:00100000:1.0:1789185917.209399:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185917.210337:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879550976 00000100:00100000:3.0:1789185917.210355:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879550976 00000100:00100000:3.0:1789185917.210442:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 138 00000100:00100000:3.0:1789185917.210455:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+11:15024:x1876096879550976:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789185917.210997:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+11:15024:x1876096879550976:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 542us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185917.211008:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 138 00000100:00100000:3.0:1789185917.213880:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185917.214106:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879551104 00000100:00100000:1.0:1789185917.214120:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879551104 00000100:00100000:1.0:1789185917.214197:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 139 00000100:00100000:1.0:1789185917.214209:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+11:15017:x1876096879551104:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789185917.214233:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185917.214259:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf9e00/0xda5c730d5a743dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5225b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.214311:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf9e00/0xda5c730d5a743dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5225b expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.214332:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf9e00/0xda5c730d5a743dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5225b expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.214343:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9e00, rc 0) 00000100:00100000:1.0:1789185917.214433:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+12:15017:x1876096879551104:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 225us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185917.214442:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 139 00000100:00100000:2.0:1789185917.222363:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185917.223538:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879551232 00000100:00100000:0.0:1789185917.223556:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879551232 00000100:00100000:0.0:1789185917.223660:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 140 00000100:00100000:0.0:1789185917.223674:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+12:15017:x1876096879551232:12345-192.168.204.48@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789185917.223710:0:17149:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789185917.223746:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789185917.223751:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789185917.223756:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789185917.223759:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789185917.223761:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789185917.226054:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+12:15017:x1876096879551232:12345-192.168.204.48@tcp:256:mount.lustre.0 Request processed in 2367us (3690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.226073:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 140 00000100:00100000:3.0:1789185917.231000:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185917.232263:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879551360 00000100:00100000:1.0:1789185917.232281:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879551360 00000100:00100000:1.0:1789185917.232499:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 141 00000100:00100000:1.0:1789185917.232514:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+12:15017:x1876096879551360:12345-192.168.204.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789185917.232539:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185917.232564:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52262 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.232618:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52262 expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.232631:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52262 expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.232643:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9a00, rc 0) 00000100:00100000:1.0:1789185917.232749:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:15017:x1876096879551360:12345-192.168.204.48@tcp:101:mount.lustre.0 Request processed in 239us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185917.232757:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 141 00000100:00100000:3.0:1789185917.235422:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185917.235607:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879551488 00000100:00100000:0.0:1789185917.235643:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879551488 00000100:00100000:0.0:1789185917.235724:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 142 00000100:00100000:0.0:1789185917.235737:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+13:15017:x1876096879551488:12345-192.168.204.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789185917.235992:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+13:15017:x1876096879551488:12345-192.168.204.48@tcp:501:mount.lustre.0 Request processed in 256us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.236002:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 142 00000100:00100000:3.0:1789185917.244292:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185917.244953:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879551616 00000100:00100000:2.0:1789185917.244968:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879551616 00000100:00100000:2.0:1789185917.245037:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 143 00000100:00100000:2.0:1789185917.245050:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+13:15017:x1876096879551616:12345-192.168.204.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789185917.245253:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+13:15017:x1876096879551616:12345-192.168.204.48@tcp:503:mount.lustre.0 Request processed in 205us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185917.245263:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 143 00000100:00100000:3.0:1789185917.250630:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185917.252431:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879551744 00000100:00100000:1.0:1789185917.252452:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879551744 00000100:00100000:1.0:1789185917.252597:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 144 00000100:00100000:1.0:1789185917.252611:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:15028:x1876096879551744:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789185917.252878:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:15028:x1876096879551744:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 270us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185917.252889:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 144 00000100:00100000:3.0:1789185917.262313:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185917.262446:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879551872 00000100:00100000:2.0:1789185917.262461:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879551872 00000100:00100000:2.0:1789185917.262542:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 145 00000100:00100000:2.0:1789185917.262555:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+13:15028:x1876096879551872:12345-192.168.204.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789185917.262806:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+13:15028:x1876096879551872:12345-192.168.204.48@tcp:502:llog_process_th.0 Request processed in 245us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185917.262823:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 145 00000100:00100000:3.0:1789185917.294351:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185917.294409:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185917.294621:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879552000 00000100:00100000:0.0:1789185917.294637:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879552000 00000100:00100000:0.0:1789185917.294708:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879552256 00000100:00100000:0.0:1789185917.294712:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879552256 00000100:00100000:0.0:1789185917.294740:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00100000:0.0:1789185917.294751:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876096879552000:12345-192.168.204.48@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789185917.294793:0:17156:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e1735a8d-9a99-4c85-bc30-d3542203dc16@192.168.204.48@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1789185917.294864:0:17156:0:(genops.c:1384:class_connect()) connect: client e1735a8d-9a99-4c85-bc30-d3542203dc16, cookie 0xda5c730d5a743ea 00000004:00100000:0.0:1789185917.294900:0:17156:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789185917.295066:0:17156:0:(import.c:65:import_set_state_nolock()) ffff98f2ffaff800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185917.295155:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2388:x1876096879552000:12345-192.168.204.48@tcp:38:mount.lustre.0 Request processed in 403us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.295175:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00100000:0.0:1789185917.295200:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:0.0:1789185917.295205:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876096879552256:12345-192.168.204.48@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789185917.295221:0:17156:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e1735a8d-9a99-4c85-bc30-d3542203dc16@192.168.204.48@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1789185917.295250:0:17156:0:(genops.c:1384:class_connect()) connect: client e1735a8d-9a99-4c85-bc30-d3542203dc16, cookie 0xda5c730d5a743f1 00000004:00100000:0.0:1789185917.295265:0:17156:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789185917.295315:0:17156:0:(import.c:65:import_set_state_nolock()) ffff98f2ffafb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185917.295363:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2388:x1876096879552256:12345-192.168.204.48@tcp:38:mount.lustre.0 Request processed in 156us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.295370:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:3.0:1789185917.297565:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185917.297674:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185917.297784:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185917.297973:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879552640 00000100:00100000:1.0:1789185917.297986:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879552640 00000100:00100000:1.0:1789185917.298051:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 146 00000100:00100000:1.0:1789185917.298064:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:2391:x1876096879552640:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185917.300640:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879552768 00000100:00100000:0.0:1789185917.300675:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879552768 00000100:00100000:0.0:1789185917.300764:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879552896 00000100:00100000:0.0:1789185917.300769:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879552896 00000100:00100000:0.0:1789185917.300827:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:0.0:1789185917.300840:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:2391:x1876096879552768:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185917.308227:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:3.0:1789185917.308259:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2392:x1876096879552896:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185917.310286:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:2391:x1876096879552640:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 11915us (12425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185917.310309:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 146 00000100:00100000:0.0:1789185917.311009:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:2391:x1876096879552768:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 10165us (13326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.311023:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:2.0:1789185917.312030:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185917.312070:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185917.312108:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185917.312142:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879552128 00000100:00100000:2.0:1789185917.312155:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879552128 00000100:00100000:2.0:1789185917.312230:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:2.0:1789185917.312242:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:0:x1876096879552128:12345-192.168.204.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789185917.312286:0:17155:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789185917.312366:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:0:x1876096879552128:12345-192.168.204.48@tcp:41:mount.lustre.0 Request processed in 126us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185917.312373:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00080000:2.0:1789185917.312397:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789185917.312430:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185917.312479:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185917.312494:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879552512 00000100:00100000:2.0:1789185917.312497:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879552512 00000100:00100000:2.0:1789185917.312511:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879552384 00000100:00100000:2.0:1789185917.312513:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879552384 00000100:00100000:2.0:1789185917.312532:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:2.0:1789185917.312538:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15017:x1876096879552512:12345-192.168.204.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789185917.312551:0:17155:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789185917.312579:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15017:x1876096879552512:12345-192.168.204.48@tcp:41:mount.lustre.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185917.312586:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:2.0:1789185917.312600:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:2.0:1789185917.312627:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:0:x1876096879552384:12345-192.168.204.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789185917.312642:0:17155:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789185917.312687:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:0:x1876096879552384:12345-192.168.204.48@tcp:41:mount.lustre.0 Request processed in 61us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185917.312693:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00080000:2.0:1789185917.312707:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185917.312791:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879553024 00000100:00100000:1.0:1789185917.312804:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879553024 00000100:00100000:1.0:1789185917.312838:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879553152 00000100:00100000:1.0:1789185917.312841:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879553152 00000100:00100000:1.0:1789185917.312863:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:1.0:1789185917.312870:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2391:x1876096879553024:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185917.313087:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:1.0:1789185917.313095:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2391:x1876096879553024:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 226us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.313096:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2392:x1876096879553152:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185917.313102:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:0.0:1789185917.313123:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2392:x1876096879553152:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 29us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.313130:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:3.0:1789185917.326531:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185917.327451:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879553280 00000100:00100000:0.0:1789185917.327468:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879553280 00000100:00100000:0.0:1789185917.327554:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:0.0:1789185917.327565:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15017:x1876096879553280:12345-192.168.204.48@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789185917.327686:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15017:x1876096879553280:12345-192.168.204.48@tcp:40:mount.lustre.0 Request processed in 122us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.327694:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:2.0:1789185917.327892:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2392:x1876096879552896:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 19645us (30105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185917.327903:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:2.0:1789185917.340017:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185917.340064:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185917.340131:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185917.340206:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879553408 00000100:00100000:1.0:1789185917.340221:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879553408 00000100:00100000:0.0:1789185917.340245:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879553664 00000100:00100000:0.0:1789185917.340249:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879553664 00000100:00100000:1.0:1789185917.340277:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879553536 00000100:00100000:1.0:1789185917.340280:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879553536 00000100:00100000:1.0:1789185917.340302:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:0.0:1789185917.340302:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:1.0:1789185917.340311:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876096879553408:12345-192.168.204.48@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789185917.340312:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15017:x1876096879553664:12345-192.168.204.48@tcp:900:mount.lustre.0 00010000:00080000:1.0:1789185917.340349:0:18663:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e1735a8d-9a99-4c85-bc30-d3542203dc16@192.168.204.48@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:1.0:1789185917.340389:0:18663:0:(genops.c:1384:class_connect()) connect: client e1735a8d-9a99-4c85-bc30-d3542203dc16, cookie 0xda5c730d5a743f8 00002000:00100000:1.0:1789185917.340403:0:18663:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e1735a8d-9a99-4c85-bc30-d3542203dc16/ffff98f1c2c6e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1789185917.340407:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15017:x1876096879553664:12345-192.168.204.48@tcp:900:mount.lustre.0 Request processed in 96us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.340414:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 4 00002000:00100000:1.0:1789185917.340418:0:18663:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789185917.340441:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:0.0:1789185917.340445:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2388:x1876096879553536:12345-192.168.204.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789185917.340461:0:18662:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e1735a8d-9a99-4c85-bc30-d3542203dc16@192.168.204.48@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1789185917.340480:0:18662:0:(genops.c:1384:class_connect()) connect: client e1735a8d-9a99-4c85-bc30-d3542203dc16, cookie 0xda5c730d5a743ff 00002000:00100000:0.0:1789185917.340485:0:18662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e1735a8d-9a99-4c85-bc30-d3542203dc16/ffff98f2ffaf8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789185917.340491:0:18662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789185917.340531:0:18663:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1789185917.340543:0:18662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789185917.340565:0:18663:0:(import.c:65:import_set_state_nolock()) ffff98f1c2c6b800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789185917.340565:0:18662:0:(import.c:65:import_set_state_nolock()) ffff98f2ffaff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789185917.340713:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2388:x1876096879553536:12345-192.168.204.48@tcp:8:mount.lustre.0 Request processed in 147us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.340722:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:0.0:1789185917.347756:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2388:x1876096879553408:12345-192.168.204.48@tcp:8:mount.lustre.0 Request processed in 7422us (7667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185917.347778:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 21 00010000:00010000:1.0:1789185917.350082:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185917.360612:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185917.360877:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879553792 00000100:00100000:3.0:1789185917.360890:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879553792 00000100:00100000:3.0:1789185917.360997:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 1 00000100:00100000:3.0:1789185917.361010:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15017:x1876096879553792:12345-192.168.204.48@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789185917.361134:0:17159:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789185917.361258:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15017:x1876096879553792:12345-192.168.204.48@tcp:33:mount.lustre.0 Request processed in 250us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185917.361267:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 1 00000100:00100000:2.0:1789185917.556231:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185917.556360:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879553920 00000100:00100000:1.0:1789185917.556374:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879553920 00000100:00100000:1.0:1789185917.556458:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:1.0:1789185917.556471:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15051:x1876096879553920:12345-192.168.204.48@tcp:101:mkdir.0 00010000:00010000:1.0:1789185917.556497:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185917.556549:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a74406 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52293 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.556637:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.556668:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.556682:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185917.556755:0:18686:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789185917.556759:0:18686:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185917.556798:0:18686:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.556841:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8800/0xda5c730d5a74406 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52293 expref: 8 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.556867:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52293 expref: 7 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185917.556876:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2c4f8dd00) 00010000:00010000:1.0:1789185917.556879:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185917.556884:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9200, rc 0) 00000100:00100000:1.0:1789185917.557028:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1735a8d-9a99-4c85-bc30-d3542203dc16+7:15051:x1876096879553920:12345-192.168.204.48@tcp:101:mkdir.0 Request processed in 558us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185917.557037:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00010000:00010000:1.0:1789185918.374202:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185918.374302:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898517120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185918.374409:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185918.374518:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898517120 00000100:00100000:1.0:1789185918.374529:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898517120 00000100:00100000:1.0:1789185918.376233:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789185918.376256:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898517120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185918.376293:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789185918.376404:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898517120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185918.376412:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789185918.378163:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185918.378254:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898517120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789185919.406962:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185919.408013:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898517248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185919.409402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185919.413676:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898517248 00000100:00100000:1.0:1789185919.413710:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898517248 00000100:00100000:0.0:1789185919.414418:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898517376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185919.414751:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789185919.414768:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898517248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789185919.415383:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789185919.415511:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876096898517248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 747us (6117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185919.415612:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789185919.415657:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185919.416500:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185919.416590:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898517376 00000100:00100000:0.0:1789185919.416599:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898517376 00000100:00100000:0.0:1789185919.417252:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185919.417499:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898517376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789185919.417566:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789185919.420228:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876096898517248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185919.420831:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898517376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3335us (4329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185919.420846:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789185919.420932:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898517376:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789185919.849134:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789185919.911354:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898517504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185919.911462:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185919.911615:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898517504 00000100:00100000:1.0:1789185919.911634:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898517504 00000100:00100000:1.0:1789185919.911714:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789185919.911726:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898517504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789185919.911773:0:17161:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789185919.918703:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898517504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6963us (7225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185919.918726:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789185919.921959:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898517504:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789185920.424879:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789185920.801409:0:20033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789185920.935588:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898517632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789185920.935686:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185920.935772:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898517632 00000100:00100000:1.0:1789185920.935782:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898517632 00000100:00100000:1.0:1789185920.935848:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789185920.935860:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898517632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185920.935927:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789185920.935985:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898517632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185920.935994:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789185920.936527:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185920.936707:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898517632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185920.937679:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185920.937699:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898517760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185920.937775:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185920.937832:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898517760 00000100:00100000:3.0:1789185920.937840:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898517760 00000100:00100000:3.0:1789185920.938133:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789185920.938156:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898517760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789185920.938182:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789185920.938232:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898517760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185920.938240:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789185920.938270:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185920.938300:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789185920.938344:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898517760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789185920.940388:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898518272:0@lo:400:kworker.0 00000100:00100000:0.0:1789185920.940482:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185920.940520:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898518784:0@lo:400:kworker.0 00000100:00100000:3.0:1789185920.941147:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898517888:0@lo:400:kworker.0 00000100:00100000:0.0:1789185920.941221:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185920.941493:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898518016:0@lo:400:kworker.0 00000001:00100000:2.0:1789185920.941627:0:17888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e1735a8d-9a99-4c85-bc30-d3542203dc16 00000001:00100000:2.0:1789185920.941639:0:17888:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8e5c6ede-0048-44ff-85dd-b5867120aa40 00000001:00100000:2.0:1789185920.941680:0:17135:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e1735a8d-9a99-4c85-bc30-d3542203dc16 00000001:00100000:2.0:1789185920.941689:0:17135:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8e5c6ede-0048-44ff-85dd-b5867120aa40 00000100:00100000:3.0:1789185920.948064:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185920.948139:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898518400:0@lo:400:kworker.0 00000100:00100000:3.0:1789185920.948190:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185920.948216:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898518912:0@lo:400:kworker.0 00000100:00100000:3.0:1789185920.948261:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898517888 00000100:00100000:3.0:1789185920.948271:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898517888 00000100:00100000:3.0:1789185920.948331:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789185920.948342:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3636:x1876096898517888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185920.948408:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3636:x1876096898517888:12345-0@lo:400:kworker.0 Request processed in 67us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185920.948416:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789185920.948457:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898518400 00000100:00100000:3.0:1789185920.948461:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898518400 00000100:00100000:3.0:1789185920.948494:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185920.948501:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898518400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185920.948555:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898518400:12345-0@lo:400:kworker.0 Request processed in 38us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185920.948587:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185920.950809:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898518272 00000100:00100000:3.0:1789185920.950827:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898518272 00000100:00100000:3.0:1789185920.950924:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898518784 00000100:00100000:3.0:1789185920.950928:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898518784 00000100:00100000:3.0:1789185920.950971:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185920.950982:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898518272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185920.951168:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898518272:12345-0@lo:400:kworker.0 Request processed in 188us (10686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185920.951176:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789185920.951199:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789185920.951205:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898518784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185920.951239:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876096898518784:12345-0@lo:400:kworker.0 Request processed in 34us (10019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185920.951245:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789185920.951273:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1789185920.952531:0:18658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1735a8d-9a99-4c85-bc30-d3542203dc16 00000001:00100000:3.0:1789185920.952545:0:18658:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8e5c6ede-0048-44ff-85dd-b5867120aa40 00000100:00100000:0.0:1789185920.953392:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876096898518784:0@lo:400:kworker.0 00000100:00100000:0.0:1789185920.953448:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898518272:0@lo:400:kworker.0 00000100:00100000:3.0:1789185920.953530:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185920.953609:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898517888:0@lo:400:kworker.0 00000100:00100000:3.0:1789185920.953625:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898518400:0@lo:400:kworker.0 00000100:00100000:0.0:1789185920.953744:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898518912 00000100:00100000:0.0:1789185920.953754:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898518912 00000100:00100000:0.0:1789185920.953833:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789185920.953845:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898518912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185920.953975:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898518912:12345-0@lo:400:kworker.0 Request processed in 133us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185920.953983:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789185920.954032:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2d2fd5180 x1876096898518912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185920.954064:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898518912:0@lo:400:kworker.0 00000100:00080000:3.0:1789185920.954795:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185920.957128:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898518144:0@lo:400:kworker.0 00000100:00100000:0.0:1789185920.957391:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185920.957455:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898518656:0@lo:400:kworker.0 00000100:00100000:0.0:1789185920.957501:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185920.957537:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898519168:0@lo:400:kworker.0 00000100:00100000:0.0:1789185920.958774:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185920.958857:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898518144 00000100:00100000:0.0:1789185920.958882:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898518144 00000100:00100000:0.0:1789185920.958988:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789185920.959001:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898518144:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789185920.959220:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185920.959237:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898518656 00000100:00100000:2.0:1789185920.959242:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898518656 00000100:00100000:2.0:1789185920.959277:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898519168 00000100:00100000:2.0:1789185920.959286:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898519168 00000100:00100000:2.0:1789185920.959313:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185920.959320:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898518656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185920.959393:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898518656:12345-0@lo:400:kworker.0 Request processed in 73us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185920.959401:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789185920.959422:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789185920.959428:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898519168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185920.959458:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898519168:12345-0@lo:400:kworker.0 Request processed in 30us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185920.959464:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789185920.959479:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185920.959519:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898518656:0@lo:400:kworker.0 00010000:00080000:2.0:1789185920.959536:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f2d2fd4e00 x1876096898519168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185920.959547:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898519168:0@lo:400:kworker.0 00000100:00100000:0.0:1789185920.959692:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898518144:12345-0@lo:400:kworker.0 Request processed in 694us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185920.959699:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789185920.959762:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898518144:0@lo:400:kworker.0 00000100:00100000:1.0:1789185920.959863:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185920.959897:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898518528:0@lo:400:kworker.0 00000100:00100000:1.0:1789185920.959941:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185920.959963:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898519040:0@lo:400:kworker.0 00000100:00100000:1.0:1789185920.959993:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185920.960037:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898519040 00000100:00100000:1.0:1789185920.960042:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898519040 00000100:00100000:1.0:1789185920.960079:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789185920.960086:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898519040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185920.960133:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876096898519040:12345-0@lo:400:kworker.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185920.960140:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789185920.960161:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898518016 00000100:00100000:1.0:1789185920.960165:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898518016 00000100:00100000:1.0:1789185920.960193:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789185920.960200:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898518016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185920.960234:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898518016:12345-0@lo:400:kworker.0 Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185920.960240:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789185920.960258:0:19112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898518528 00000100:00100000:1.0:1789185920.960261:0:19112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898518528 00000100:00100000:1.0:1789185920.960284:0:19112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789185920.960290:0:19112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898518528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185920.960319:0:19112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898518528:12345-0@lo:400:kworker.0 Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185920.960325:0:19112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789185920.960339:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789185920.961232:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898518016:0@lo:400:kworker.0 00000100:00100000:1.0:1789185920.961249:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898518528:0@lo:400:kworker.0 00000100:00100000:1.0:1789185920.961260:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876096898519040:0@lo:400:kworker.0 00010000:00010000:1.0:1789185921.446134:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185922.418069:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185922.418117:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185922.418150:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185922.418168:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185922.418191:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185922.418210:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185922.418228:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185922.418247:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185922.418294:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185922.418337:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879554176 00000100:00100000:2.0:1789185922.418349:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879554176 00000100:00100000:0.0:1789185922.418756:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879554432 00000100:00100000:0.0:1789185922.418762:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879554432 00000100:00100000:0.0:1789185922.418816:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879554944 00000100:00100000:0.0:1789185922.418819:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879554944 00000100:00100000:0.0:1789185922.418835:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879554560 00000100:00100000:0.0:1789185922.418837:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879554560 00000100:00100000:0.0:1789185922.418852:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879555072 00000100:00100000:0.0:1789185922.418855:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879555072 00000100:00100000:0.0:1789185922.418876:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:0.0:1789185922.418889:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879554432:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185922.419015:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879554432:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 127us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185922.419029:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:0.0:1789185922.419049:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:0.0:1789185922.419055:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879554944:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185922.419097:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879554944:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 42us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185922.419104:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:0.0:1789185922.419116:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:0.0:1789185922.419134:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879554560:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185922.419164:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879554560:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 32us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185922.419170:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:0.0:1789185922.419180:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:0.0:1789185922.419187:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2390:x1876096879555072:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185922.419206:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2390:x1876096879555072:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 20us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185922.419211:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:0.0:1789185922.419232:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879554688 00000100:00100000:0.0:1789185922.419235:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879554688 00000100:00100000:2.0:1789185922.419411:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879554304 00000100:00100000:2.0:1789185922.419416:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879554304 00000100:00100000:2.0:1789185922.424964:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879554816 00000100:00100000:2.0:1789185922.424986:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879554816 00000100:00100000:2.0:1789185922.425044:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 49 00000100:00100000:1.0:1789185922.425063:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 50 00000100:00100000:1.0:1789185922.425075:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2390:x1876096879554688:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185922.425194:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2390:x1876096879554688:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 121us (7041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185922.425221:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 50 00000100:00100000:1.0:1789185922.425242:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:1.0:1789185922.425248:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879554304:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185922.425277:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879554304:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 30us (7067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185922.425282:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:1.0:1789185922.425296:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:1.0:1789185922.425301:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879554816:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:1.0:1789185922.425325:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879554816:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 24us (7077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185922.425330:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:2.0:1789185922.425734:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2390:x1876096879554176:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185922.428375:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2390:x1876096879554176:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 3300us (10309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185922.429141:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 49 00000100:00100000:2.0:1789185922.429211:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879554048 00000100:00100000:2.0:1789185922.429221:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879554048 00000100:00100000:2.0:1789185922.429288:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 148 00000100:00100000:2.0:1789185922.429299:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:2390:x1876096879554048:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185922.429384:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:2390:x1876096879554048:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 87us (11190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185922.429392:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 148 00000100:00080000:2.0:1789185922.429462:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185922.429471:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185922.429475:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185922.429478:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789185922.471657:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789185922.983853:0:19478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1735a8d-9a99-4c85-bc30-d3542203dc16 00010000:00010000:1.0:1789185923.494371:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185923.494427:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185923.494457:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2f2bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898519296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185923.494564:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185923.494944:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898519296 00000100:00100000:1.0:1789185923.494956:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898519296 00000100:00100000:1.0:1789185923.495037:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789185923.495051:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898519296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789185923.495090:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789185923.495149:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898519296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185923.495158:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789185923.495220:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789185923.495403:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2f2bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898519296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789185924.519272:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898519424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185924.519346:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185924.520229:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789185924.520250:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898519552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789185924.520293:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789185924.520357:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185924.520376:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898519424 00000100:00100000:2.0:1789185924.520383:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898519424 00000100:00100000:2.0:1789185924.520429:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789185924.520438:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898519424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185924.520471:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789185924.520611:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898519424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 173us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185924.520618:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789185924.520653:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898519552 00000100:00100000:2.0:1789185924.520657:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898519552 00000100:00100000:2.0:1789185924.520694:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789185924.520700:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898519552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185924.520713:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789185924.520747:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898519552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185924.520754:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789185924.520769:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185924.520800:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898519552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789185924.522141:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898519424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185925.031898:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789185925.031952:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898519680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185925.032021:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185925.032605:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898519680 00000100:00100000:2.0:1789185925.032615:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898519680 00000100:00100000:2.0:1789185925.032671:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789185925.032680:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2f2bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898519680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185925.032715:0:17896:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789185925.032775:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2f2bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898519680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185925.032793:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789185925.033488:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898519680:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1789185925.271264:0:20181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe91db42c0 20000000:00000080:1.0:1789185925.271361:0:20181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f2d8611800 uarg=0000000000000000 20000000:01000000:1.0:1789185925.271408:0:20181:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789185925.271414:0:20181:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789185925.271419:0:20181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789185925.272259:0:20182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789185925.272608:0:20181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789185925.284444:0:20181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789185925.284897:0:20181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.284943:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a740a2 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.284952:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a740b0 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.284959:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a740ef expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.284967:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a7424d expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.284977:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521f2 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.284985:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52262 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.284993:0:20181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.285039:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52262 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.285056:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52262 expref: 12 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.285072:0:20181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898519808:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185925.285203:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521f2 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.285212:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521f2 expref: 12 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.285221:0:20181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898519936:192.168.204.48@tcp:104: 00010000:00010000:0.0:1789185925.285261:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a7424d expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.285475:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a7424d expref: 23 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.285487:0:20181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898520064:0@lo:104: 00000100:00100000:0.0:1789185925.285557:0:20181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185925.285604:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a740ef expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.285612:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a740ef expref: 23 pid: 17149 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.285621:0:20181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898520192:0@lo:104: 00000100:00100000:0.0:1789185925.285642:0:20181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185925.285664:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a740b0 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.285672:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a740b0 expref: 23 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.285679:0:20181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898520320:0@lo:104: 00000100:00100000:0.0:1789185925.285709:0:20181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789185925.285727:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xda5c730d5a740a2 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185925.285734:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xda5c730d5a740a2 expref: 23 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.285743:0:20181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d2fd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898520448:0@lo:104: 00000100:00100000:0.0:1789185925.285761:0:20181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185925.285770:0:20181:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f28fe780 going to sleep for 11 seconds 00000100:00100000:3.0:1789185925.285851:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898520064 00000100:00100000:3.0:1789185925.285864:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898520064 00000100:00100000:3.0:1789185925.285898:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898520192 00000100:00100000:3.0:1789185925.285900:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898520192 00000100:00100000:3.0:1789185925.285941:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898520320 00000100:00100000:3.0:1789185925.285944:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898520320 00000100:00100000:3.0:1789185925.285954:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898520448 00000100:00100000:3.0:1789185925.285955:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898520448 00000100:00100000:3.0:1789185925.285968:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185925.285976:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+6:20181:x1876096898520064:12345-0@lo:104: 00010000:00010000:3.0:1789185925.285988:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286039:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789185925.286045:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+6:20181:x1876096898520064:12345-0@lo:104: Request processed in 71us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185925.286052:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185925.286070:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185925.286075:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+5:20181:x1876096898520192:12345-0@lo:104: 00010000:00010000:3.0:1789185925.286083:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286115:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789185925.286120:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+5:20181:x1876096898520192:12345-0@lo:104: Request processed in 45us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185925.286126:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185925.286138:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185925.286144:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+4:20181:x1876096898520320:12345-0@lo:104: 00010000:00010000:3.0:1789185925.286151:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286205:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789185925.286210:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+4:20181:x1876096898520320:12345-0@lo:104: Request processed in 67us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185925.286216:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185925.286228:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185925.286243:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:20181:x1876096898520448:12345-0@lo:104: 00010000:00010000:3.0:1789185925.286251:0:17139:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286287:0:17139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789185925.286292:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+3:20181:x1876096898520448:12345-0@lo:104: Request processed in 58us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185925.286297:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789185925.286317:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789185925.286322:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286330:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030c00 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185925.286334:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286343:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185925.286351:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185925.286357:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185925.286397:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286403:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185925.286425:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286431:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0030c00/0xda5c730d5a7424d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a74254 expref: -99 pid: 19477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286443:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789185925.286446:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286452:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0000 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185925.286454:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286460:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185925.286466:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185925.286473:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185925.286485:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286491:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185925.286507:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286524:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2ff9c0000/0xda5c730d5a740ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a740f6 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286533:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789185925.286536:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286542:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031800 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185925.286545:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286552:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185925.286558:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185925.286564:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185925.286577:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286582:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185925.286596:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286603:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f2c0031800/0xda5c730d5a740b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a740b7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286610:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789185925.286620:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286626:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402f400 already unused, calling callback (ffffffffc131bc20) 10000000:00010000:3.0:1789185925.286628:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286635:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789185925.286641:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185925.286646:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789185925.286658:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286664:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789185925.286671:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286676:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.148@tcp lock: ffff98f1c402f400/0xda5c730d5a740a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xda5c730d5a740a9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.286688:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185925.286690:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789185925.286692:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185925.286712:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898520576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185925.286743:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185925.286766:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789185925.286771:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898520704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185925.286800:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185925.286829:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898520960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185925.286849:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185925.286866:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789185925.286872:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898520832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185925.286892:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185925.286935:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898520576 00000100:00100000:3.0:1789185925.286939:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898520576 00010000:00010000:3.0:1789185925.286960:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7424d expref: 24 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185925.286975:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898520704 00000100:00100000:3.0:1789185925.286978:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898520704 00010000:00010000:3.0:1789185925.286988:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a740ef expref: 25 pid: 17149 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185925.286999:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898520960 00000100:00100000:3.0:1789185925.287001:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898520960 00010000:00010000:3.0:1789185925.287012:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a740a2 expref: 26 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185925.287021:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898520832 00000100:00100000:3.0:1789185925.287024:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898520832 00010000:00010000:3.0:1789185925.287035:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a740b0 expref: 27 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185925.287047:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185925.287053:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+27:3635:x1876096898520576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185925.287063:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185925.287069:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a7424d expref: 27 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.287085:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a7424d expref: 27 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.287102:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185925.287133:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+27:3635:x1876096898520576:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185925.287140:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789185925.287155:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185925.287161:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+26:3635:x1876096898520704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185925.287169:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185925.287174:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a740ef expref: 26 pid: 17149 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.287181:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a740ef expref: 26 pid: 17149 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.287190:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185925.287210:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+26:3635:x1876096898520704:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185925.287215:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789185925.287227:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185925.287233:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+25:3638:x1876096898520960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185925.287240:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185925.287244:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a740a2 expref: 25 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.287251:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a740a2 expref: 25 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.287267:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185925.287294:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+25:3638:x1876096898520960:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185925.287300:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789185925.287315:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185925.287320:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3638:x1876096898520832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789185925.287328:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185925.287332:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xda5c730d5a740b0 expref: 24 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.287338:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xda5c730d5a740b0 expref: 24 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.287346:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185925.287364:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3638:x1876096898520832:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185925.287369:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789185925.287406:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898520832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185925.287414:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3638:1876096898520960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185925.287446:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898520704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789185925.287454:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898520576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789185925.287792:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2ff9c0e00/0xda5c730d5a74254 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a7424d expref: 23 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.287805:0:20181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898520064:0@lo:104: 00010000:00010000:0.0:1789185925.287814:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031200/0xda5c730d5a740f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a740ef expref: 22 pid: 17149 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.287822:0:20181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898520192:0@lo:104: 00010000:00010000:0.0:1789185925.287830:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a740b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a740b0 expref: 21 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.287836:0:20181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898520320:0@lo:104: 00010000:00010000:0.0:1789185925.287844:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c13a3c00/0xda5c730d5a740a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xda5c730d5a740a2 expref: 20 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185925.287852:0:20181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898520448:0@lo:104: 00010000:00010000:1.0:1789185925.287958:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185925.291643:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185925.291722:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185925.291976:0:20181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898519808:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185925.292009:0:20181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d2fd6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1876096898519936:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185925.292044:0:20181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185925.292230:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879555200 00000100:00100000:3.0:1789185925.292247:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879555200 00010000:00010000:3.0:1789185925.292296:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52262 expref: 13 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185925.292348:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879555328 00000100:00100000:1.0:1789185925.292448:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:1.0:1789185925.292459:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aef2505e-7927-4768-ad72-37facf71ba21+13:2391:x1876096879555200:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185925.292475:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185925.292482:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52262 expref: 13 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185925.292509:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52262 expref: 13 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185925.292537:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c1bf9a00/0xda5c730d5a743e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52262 expref: 13 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185925.292552:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185925.292606:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aef2505e-7927-4768-ad72-37facf71ba21+12:2391:x1876096879555200:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 149us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185925.292614:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:3.0:1789185925.293061:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879555328 00010000:00010000:3.0:1789185925.293082:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521f2 expref: 12 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185925.293108:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:3.0:1789185925.293116:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aef2505e-7927-4768-ad72-37facf71ba21+12:2391:x1876096879555328:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185925.293125:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185925.293130:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521f2 expref: 12 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293140:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521f2 expref: 12 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293151:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f1c402fa00/0xda5c730d5a743a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee521f2 expref: 12 pid: 17150 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293165:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293173:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293189:0:17142:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293196:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293215:0:17142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293222:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293229:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:3.0:1789185925.293355:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293364:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293378:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.293387:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185925.293424:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aef2505e-7927-4768-ad72-37facf71ba21+11:2391:x1876096879555328:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 309us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185925.293431:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 14 00010000:00010000:1.0:1789185925.293727:0:20181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185925.293736:0:20181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185925.293742:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f2c0031000/0xda5c730d5a74414 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185925.543900:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789185925.738432:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789185926.057715:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789185926.057748:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898521088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789185926.057839:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185926.057895:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898521088 00000100:00100000:2.0:1789185926.057902:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898521088 00000100:00100000:2.0:1789185926.057970:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789185926.057980:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898521088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789185926.058010:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789185926.058063:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898521088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.058070:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789185926.058094:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185926.059421:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898521088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185926.060072:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898521344:0@lo:400:kworker.0 00000100:00100000:3.0:1789185926.060128:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185926.060157:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898521856:0@lo:400:kworker.0 00000100:00100000:3.0:1789185926.060181:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185926.060199:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898522368:0@lo:400:kworker.0 00000100:00100000:3.0:1789185926.060240:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185926.060288:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898521600:0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.060985:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898521216:0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061024:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185926.061057:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898521728:0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061081:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185926.061099:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898522240:0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061130:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898521344 00000100:00100000:2.0:1789185926.061137:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898521344 00000100:00100000:2.0:1789185926.061180:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898521728 00000100:00100000:2.0:1789185926.061183:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898521728 00000100:00100000:2.0:1789185926.061197:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789185926.061213:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898521344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061263:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898521344:12345-0@lo:400:kworker.0 Request processed in 51us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.061270:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789185926.061287:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789185926.061293:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898521728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061324:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898521728:12345-0@lo:400:kworker.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.061330:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789185926.061374:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898521472:0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061399:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185926.061418:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898521984:0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061436:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185926.061452:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898522496:0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061477:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898521856 00000100:00100000:2.0:1789185926.061498:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898521856 00000100:00100000:2.0:1789185926.061543:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898521472 00000100:00100000:2.0:1789185926.061546:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898521472 00000100:00100000:2.0:1789185926.061558:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898521984 00000100:00100000:2.0:1789185926.061560:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898521984 00000100:00100000:2.0:1789185926.061574:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789185926.061580:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898521856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061612:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898521856:12345-0@lo:400:kworker.0 Request processed in 33us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.061619:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789185926.061630:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789185926.061643:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898521472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061691:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898521472:12345-0@lo:400:kworker.0 Request processed in 48us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.061697:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789185926.061709:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789185926.061715:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898521984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061740:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898521984:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.061746:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789185926.061769:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185926.061772:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185926.061814:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898521216 00000100:00100000:2.0:1789185926.061818:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898521216 00000100:00100000:2.0:1789185926.061844:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789185926.061850:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:3636:x1876096898521216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.061884:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:3636:x1876096898521216:12345-0@lo:400:kworker.0 Request processed in 34us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.061890:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789185926.071241:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898521344:0@lo:400:kworker.0 00000100:00100000:3.0:1789185926.071259:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898521856:0@lo:400:kworker.0 00000100:00100000:3.0:1789185926.071309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185926.071347:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898521472:0@lo:400:kworker.0 00000100:00100000:3.0:1789185926.071360:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898521984:0@lo:400:kworker.0 00000100:00100000:3.0:1789185926.071392:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898522368 00000100:00100000:3.0:1789185926.071399:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898522368 00000100:00100000:3.0:1789185926.071453:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898522496 00000100:00100000:3.0:1789185926.071456:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898522496 00000100:00100000:0.0:1789185926.071646:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185926.071677:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898522752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185926.071732:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185926.071759:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3636:1876096898521216:0@lo:400:kworker.0 00000100:00100000:0.0:1789185926.071770:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898521728:0@lo:400:kworker.0 00000100:00100000:0.0:1789185926.071796:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898522752 00000100:00100000:0.0:1789185926.071800:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898522752 00000100:00100000:0.0:1789185926.071827:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789185926.071836:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898522752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789185926.071859:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789185926.071900:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898522752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185926.071928:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789185926.071970:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898522752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185926.072004:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898522240 00000100:00100000:0.0:1789185926.072008:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898522240 00000100:00100000:2.0:1789185926.075033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185926.075082:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c19b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898522112:0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.075139:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185926.075154:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898522624:0@lo:400:kworker.0 00000100:00100000:2.0:1789185926.075174:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185926.075456:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185926.075493:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898522368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185926.075566:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876096898522368:12345-0@lo:400:kworker.0 Request processed in 98us (15324us total) trans 0 rc 0/0 00010000:00080000:2.0:1789185926.075642:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c19b7480 x1876096898522368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789185926.075657:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876096898522368:0@lo:400:kworker.0 00000100:00080000:2.0:1789185926.080881:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185926.080892:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789185926.081893:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898521600 00000100:00100000:0.0:1789185926.081919:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898521600 00000100:00100000:0.0:1789185926.081961:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898522112 00000100:00100000:0.0:1789185926.081965:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898522112 00000100:00100000:0.0:1789185926.081980:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898522624 00000100:00100000:0.0:1789185926.081983:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898522624 00000100:00100000:0.0:1789185926.082018:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789185926.082028:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898522496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185926.082133:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876096898522496:12345-0@lo:400:kworker.0 Request processed in 106us (10823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185926.082158:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789185926.082179:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789185926.082186:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898522240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185926.082224:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876096898522240:12345-0@lo:400:kworker.0 Request processed in 39us (10579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185926.082230:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789185926.082245:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789185926.082251:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898521600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185926.082287:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876096898521600:12345-0@lo:400:kworker.0 Request processed in 36us (7262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185926.082293:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789185926.082304:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789185926.082310:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898522112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185926.082338:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876096898522112:12345-0@lo:400:kworker.0 Request processed in 27us (7198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185926.082343:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789185926.082355:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789185926.082362:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898522624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789185926.082390:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876096898522624:12345-0@lo:400:kworker.0 Request processed in 29us (7214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185926.082396:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789185926.082445:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876096898521600:0@lo:400:kworker.0 00000100:00100000:0.0:1789185926.082460:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876096898522112:0@lo:400:kworker.0 00000100:00080000:2.0:1789185926.082724:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789185926.082790:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c36ef100 x1876096898522624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789185926.082802:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876096898522624:0@lo:400:kworker.0 00000100:00100000:0.0:1789185926.082852:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c19b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876096898522240:0@lo:400:kworker.0 00000100:00100000:3.0:1789185926.083042:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789185926.083079:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876096898522496:0@lo:400:kworker.0 00010000:00010000:2.0:1789185926.569058:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185926.634602:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185926.635086:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879555456 00000100:00100000:2.0:1789185926.635099:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879555456 00000100:00100000:2.0:1789185926.635171:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 150 00000100:00100000:2.0:1789185926.635180:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+11:14901:x1876096879555456:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185926.635197:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185926.635219:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402f000/0xda5c730d5a7441b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5229a expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185926.635248:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402f000/0xda5c730d5a7441b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5229a expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185926.635261:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402f000/0xda5c730d5a7441b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5229a expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185926.635271:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f000, rc 0) 00000100:00100000:2.0:1789185926.635327:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+12:14901:x1876096879555456:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 Request processed in 148us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.635333:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 150 00000100:00100000:2.0:1789185926.654682:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185926.654850:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879555584 00000100:00100000:3.0:1789185926.654861:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879555584 00000100:00100000:3.0:1789185926.654965:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 151 00000100:00100000:3.0:1789185926.654976:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+12:14901:x1876096879555584:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185926.655138:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+12:14901:x1876096879555584:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 Request processed in 164us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185926.655147:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 151 00000100:00100000:0.0:1789185926.668278:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185926.668401:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879555712 00000100:00100000:2.0:1789185926.668411:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879555712 00000100:00100000:2.0:1789185926.668475:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 152 00000100:00100000:2.0:1789185926.668487:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+12:14901:x1876096879555712:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185926.668632:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+12:14901:x1876096879555712:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 Request processed in 147us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.668648:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 152 00000100:00100000:3.0:1789185926.697645:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185926.697729:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879555840 00000100:00100000:2.0:1789185926.697741:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879555840 00000100:00100000:2.0:1789185926.697802:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 153 00000100:00100000:2.0:1789185926.697813:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+12:14901:x1876096879555840:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789185926.697832:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185926.697851:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a74422 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522a1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185926.697881:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a74422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522a1 expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185926.697892:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c402fe00/0xda5c730d5a74422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522a1 expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185926.697901:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402fe00, rc 0) 00000100:00100000:2.0:1789185926.697992:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aef2505e-7927-4768-ad72-37facf71ba21+13:14901:x1876096879555840:12345-192.168.204.48@tcp:101:ll_cfg_requeue.0 Request processed in 180us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.697999:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 153 00000100:00100000:2.0:1789185926.731485:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185926.731558:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879555968 00000100:00100000:3.0:1789185926.731881:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879555968 00000100:00100000:3.0:1789185926.732148:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 154 00000100:00100000:3.0:1789185926.732159:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:14901:x1876096879555968:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185926.732308:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:14901:x1876096879555968:12345-192.168.204.48@tcp:501:ll_cfg_requeue.0 Request processed in 150us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185926.732316:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 154 00000100:00100000:1.0:1789185926.738024:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185926.738751:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879556096 00000100:00100000:2.0:1789185926.738762:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879556096 00000100:00100000:2.0:1789185926.738821:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 155 00000100:00100000:2.0:1789185926.738832:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f301cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+13:14901:x1876096879556096:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185926.738992:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f301cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+13:14901:x1876096879556096:12345-192.168.204.48@tcp:503:ll_cfg_requeue.0 Request processed in 162us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185926.739010:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 155 10000000:01000000:3.0:1789185927.274224:0:17153:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185927.274236:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f1c201e800 from 13 10000000:01000000:3.0:1789185927.274247:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185927.274318:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30dac00/0xda5c730d5a74429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.274335:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30dac00/0xda5c730d5a74429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.274351:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30dac00/0xda5c730d5a74429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185927.274386:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898522880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.275767:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185927.275835:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3000760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185927.275870:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898522880 00000100:00100000:3.0:1789185927.275881:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898522880 00000100:00100000:3.0:1789185927.275965:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789185927.275977:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+20:17153:x1876096898522880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185927.275999:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185927.276048:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30db400/0xda5c730d5a74430 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a74429 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.276085:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30db400/0xda5c730d5a74430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a74429 expref: 21 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.276100:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30db400/0xda5c730d5a74430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74429 expref: 21 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.276111:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db400, rc 0) 00000100:00100000:3.0:1789185927.276167:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:17153:x1876096898522880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.276174:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789185927.278623:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898522880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185927.278664:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30dac00/0xda5c730d5a74429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74430 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.278680:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30dac00/0xda5c730d5a74429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a74430 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185927.278799:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.278876:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185927.278946:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3000760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185927.279164:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898523008 00000100:00100000:1.0:1789185927.279173:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898523008 00000100:00100000:1.0:1789185927.279234:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789185927.279244:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:17153:x1876096898523008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185927.279406:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:17153:x1876096898523008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185927.279414:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789185927.279709:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.279769:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.279815:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185927.279848:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f3000760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789185927.279993:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898523136 00000100:00100000:2.0:1789185927.279999:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898523136 00000100:00100000:2.0:1789185927.280043:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789185927.280051:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:17153:x1876096898523136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789185927.280160:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:17153:x1876096898523136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185927.280168:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789185927.280308:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789185927.295930:0:20254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789185927.296127:0:17153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789185927.296165:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789185927.296181:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30dac00/0xda5c730d5a74429 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74430 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185927.296197:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30dac00/0xda5c730d5a74429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a74430 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789185927.296278:0:17153:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789185927.296283:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f2e65a0800 from 13 10000000:01000000:1.0:1789185927.296287:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789185927.296361:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8800/0xda5c730d5a74437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185927.296383:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8800/0xda5c730d5a74437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185927.296399:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8800/0xda5c730d5a74437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185927.296433:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789185927.296544:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185927.296595:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f74249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185927.296623:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898523264 00000100:00100000:1.0:1789185927.296632:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898523264 00000100:00100000:1.0:1789185927.296698:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789185927.297202:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d27ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+21:17153:x1876096898523264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185927.297223:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185927.297241:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a7443e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a74437 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185927.297275:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a7443e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a74437 expref: 22 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185927.297288:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f1c1bf9600/0xda5c730d5a7443e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74437 expref: 22 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185927.297349:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9600, rc 0) 00000100:00100000:1.0:1789185927.297408:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d27ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:17153:x1876096898523264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 700us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185927.297417:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789185927.297659:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789185927.297680:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8800/0xda5c730d5a74437 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7443e expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185927.297690:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8800/0xda5c730d5a74437 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7443e expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185927.297904:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185927.297965:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185927.297987:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2f74249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789185927.298008:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898523392 00000100:00100000:1.0:1789185927.298013:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898523392 00000100:00100000:1.0:1789185927.298042:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789185927.298049:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:17153:x1876096898523392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185927.298268:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:17153:x1876096898523392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185927.298277:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789185927.298392:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789185927.298423:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185927.298480:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185927.298494:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e79a1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789185927.298639:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898523520 00000100:00100000:1.0:1789185927.298645:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898523520 00000100:00100000:1.0:1789185927.298669:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789185927.298676:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:17153:x1876096898523520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789185927.298882:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:17153:x1876096898523520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185927.298897:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789185927.298972:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789185927.308067:0:20256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789185927.308251:0:17153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789185927.308281:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789185927.308296:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8800/0xda5c730d5a74437 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7443e expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185927.308311:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c1bf8800/0xda5c730d5a74437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7443e expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789185927.308325:0:17153:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789185927.308329:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f1c316e800 from 13 10000000:01000000:2.0:1789185927.308332:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789185927.308386:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402e000/0xda5c730d5a74445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185927.308395:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f1c402e000/0xda5c730d5a74445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185927.308410:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f1c402e000/0xda5c730d5a74445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185927.308443:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4152680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789185927.308557:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185927.308619:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2fcbef9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789185927.308769:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898523648 00000100:00100000:3.0:1789185927.308779:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898523648 00000100:00100000:3.0:1789185927.308843:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789185927.308855:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+22:17153:x1876096898523648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185927.308873:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185927.308889:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a7444c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a74445 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.308945:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a7444c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a74445 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.308958:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30daa00/0xda5c730d5a7444c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74445 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.308969:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30daa00, rc 0) 00000100:00100000:3.0:1789185927.309015:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898523648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.309023:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789185927.309090:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4152680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185927.309107:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f1c402e000/0xda5c730d5a74445 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7444c expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.309117:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f1c402e000/0xda5c730d5a74445 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7444c expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185927.309182:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.309218:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185927.309234:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185927.309247:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898523776 00000100:00100000:3.0:1789185927.309251:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898523776 00000100:00100000:3.0:1789185927.309273:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789185927.309280:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898523776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.309403:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898523776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.309411:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789185927.309440:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.309479:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.309524:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185927.309537:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076480 going to sleep for 11 seconds 00000100:00100000:3.0:1789185927.309548:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898523904 00000100:00100000:3.0:1789185927.309552:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898523904 00000100:00100000:3.0:1789185927.309571:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789185927.309576:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898523904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.309663:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898523904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.309670:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789185927.309709:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898523904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789185927.310391:0:20257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789185927.310447:0:17153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789185927.310479:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185927.310489:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f1c402e000/0xda5c730d5a74445 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7444c expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.310506:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f1c402e000/0xda5c730d5a74445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7444c expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789185927.310517:0:17153:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789185927.310520:0:17153:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98f1c41b6000 from 13 10000000:01000000:3.0:1789185927.310522:0:17153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789185927.310551:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da600/0xda5c730d5a74453 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.310559:0:17153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.148@tcp lock: ffff98f2c30da600/0xda5c730d5a74453 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.310569:0:17153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.148@tcp lock: ffff98f2c30da600/0xda5c730d5a74453 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185927.310585:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898524032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.310624:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185927.310642:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f300076240 going to sleep for 11 seconds 00000100:00100000:3.0:1789185927.310660:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898524032 00000100:00100000:3.0:1789185927.310664:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898524032 00000100:00100000:3.0:1789185927.310696:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789185927.310703:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+23:17153:x1876096898524032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185927.310713:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185927.310726:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a7445a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xda5c730d5a74453 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.310747:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a7445a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xda5c730d5a74453 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.310774:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f2c30dbe00/0xda5c730d5a7445a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xda5c730d5a74453 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.310784:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dbe00, rc 0) 00000100:00100000:3.0:1789185927.310818:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:17153:x1876096898524032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.310825:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789185927.310867:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898524032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789185927.310878:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.148@tcp lock: ffff98f2c30da600/0xda5c730d5a74453 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7445a expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.310888:0:17153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.148@tcp lock: ffff98f2c30da600/0xda5c730d5a74453 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xda5c730d5a7445a expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185927.310958:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898524160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.310982:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185927.310993:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1789185927.311004:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898524160 00000100:00100000:3.0:1789185927.311007:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898524160 00000100:00100000:3.0:1789185927.311024:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789185927.311030:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:17153:x1876096898524160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.311135:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:17153:x1876096898524160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.311142:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789185927.311281:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898524160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.311314:0:17153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898524288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.311353:0:17153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185927.311365:0:17153:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1789185927.311375:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898524288 00000100:00100000:3.0:1789185927.311379:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898524288 00000100:00100000:3.0:1789185927.311397:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789185927.311403:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:17153:x1876096898524288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789185927.311505:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:17153:x1876096898524288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.311512:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789185927.311549:0:17153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:17153:1876096898524288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789185927.313946:0:20259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789185927.314159:0:17153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789185927.314189:0:17153:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789185927.314205:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.148@tcp lock: ffff98f2c30da600/0xda5c730d5a74453 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7445a expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185927.314220:0:17153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.148@tcp lock: ffff98f2c30da600/0xda5c730d5a74453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xda5c730d5a7445a expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185927.527594:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185927.527642:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185927.527718:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185927.527747:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185927.527776:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185927.527797:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185927.527817:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185927.527854:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185927.527929:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185927.527971:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879556352 00000100:00100000:3.0:1789185927.527984:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879556352 00000100:00100000:3.0:1789185927.528052:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879556864 00000100:00100000:3.0:1789185927.528055:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879556864 00000100:00100000:3.0:1789185927.528071:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879556480 00000100:00100000:3.0:1789185927.528074:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879556480 00000100:00100000:3.0:1789185927.528086:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879556992 00000100:00100000:3.0:1789185927.528088:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879556992 00000100:00100000:3.0:1789185927.528105:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:3.0:1789185927.528116:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2392:x1876096879556352:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185927.534300:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2392:x1876096879556352:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 6165us (6700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.534323:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:3.0:1789185927.534382:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:3.0:1789185927.534399:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2392:x1876096879556864:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185927.534471:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2392:x1876096879556864:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 80us (6753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.534477:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:3.0:1789185927.534492:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:3.0:1789185927.534501:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2392:x1876096879556480:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185927.534530:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2392:x1876096879556480:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 32us (6732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.534536:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:3.0:1789185927.534549:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 62 00000100:00100000:3.0:1789185927.534576:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2392:x1876096879556992:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185927.534605:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2392:x1876096879556992:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 30us (6750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.534611:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 62 00000100:00100000:3.0:1789185927.534648:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879556224 00000100:00100000:3.0:1789185927.534659:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879556224 00000100:00100000:3.0:1789185927.534705:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 168 00000100:00100000:3.0:1789185927.534712:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:2392:x1876096879556224:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185927.534740:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aef2505e-7927-4768-ad72-37facf71ba21+13:2392:x1876096879556224:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 28us (6962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185927.534745:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 168 00000100:00100000:3.0:1789185927.535439:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879556608 00000100:00100000:3.0:1789185927.535448:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879556608 00000100:00100000:2.0:1789185927.535642:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879557120 00000100:00100000:2.0:1789185927.535649:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879557120 00000100:00100000:2.0:1789185927.535693:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879556736 00000100:00100000:2.0:1789185927.535697:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879556736 00000100:00100000:2.0:1789185927.535714:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879557248 00000100:00100000:2.0:1789185927.535717:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879557248 00000100:00100000:2.0:1789185927.535737:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:2.0:1789185927.535746:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d8316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2392:x1876096879557120:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185927.535819:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d8316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2392:x1876096879557120:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 74us (8070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185927.535826:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:2.0:1789185927.535843:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:2.0:1789185927.535850:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2392:x1876096879556736:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185927.535874:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2392:x1876096879556736:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 25us (8057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185927.535879:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:2.0:1789185927.535888:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:2.0:1789185927.535893:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2392:x1876096879557248:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185927.535930:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2392:x1876096879557248:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 36us (8022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185927.535936:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00080000:2.0:1789185927.535954:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789185927.535958:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789185927.535961:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789185927.535972:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789185927.536083:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185927.536106:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:2.0:1789185927.536558:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2392:x1876096879556608:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185927.536659:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2392:x1876096879556608:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 544us (9015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185927.547302:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00010000:00010000:3.0:1789185927.597412:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789185928.614458:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789185928.615303:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898524416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789185928.615367:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185928.617348:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898524416 00000100:00100000:0.0:1789185928.617364:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898524416 00000100:00100000:0.0:1789185928.617463:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789185928.617475:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898524416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789185928.617508:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789185928.617597:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876096898524416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185928.617604:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789185928.617689:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185928.617733:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876096898524416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789185929.005900:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185929.006133:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879557376 00000100:00100000:0.0:1789185929.006143:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879557376 00000100:00080000:2.0:1789185929.006289:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789185929.006366:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:3.0:1789185929.006378:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:15568:x1876096879557376:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185929.006398:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185929.006419:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522a8 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.006495:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.006509:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.006736:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.006754:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.006763:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.006769:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.006845:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db200/0xda5c730d5a74476 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.006854:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db200/0xda5c730d5a74476 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.006861:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db200/0xda5c730d5a74476 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185929.006889:0:18686:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789185929.006893:0:18686:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789185929.007026:0:18686:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db200/0xda5c730d5a74476 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007038:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007045:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007063:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007069:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dbc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185929.007073:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007079:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007160:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2c4f8dd00) 00010000:00010000:3.0:1789185929.007164:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185929.007170:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007176:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74468 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007188:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007194:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007199:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007204:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185929.007220:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007235:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007242:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98f2f28eee00) 00010000:00010000:3.0:1789185929.007245:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185929.007248:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007253:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a7446f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007286:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522a8 expref: 8 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007300:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db200/0xda5c730d5a74476 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522a8 expref: 7 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.007306:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f2f28ee800) 00010000:00010000:3.0:1789185929.007308:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789185929.007310:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db200, rc 0) 00000100:00100000:3.0:1789185929.007421:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:15568:x1876096879557376:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 1045us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185929.007440:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:0.0:1789185929.018530:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.019079:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879557504 00000100:00100000:2.0:1789185929.019095:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879557504 00000100:00100000:2.0:1789185929.019169:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:2.0:1789185929.019181:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:15568:x1876096879557504:12345-192.168.204.48@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789185929.019274:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:15568:x1876096879557504:12345-192.168.204.48@tcp:900:lhsmtool_posix.0 Request processed in 95us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.019281:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:1.0:1789185929.024335:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.024758:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879557760 00000100:00100000:3.0:1789185929.024769:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879557760 00000100:00100000:3.0:1789185929.024841:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:3.0:1789185929.024851:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:15568:x1876096879557760:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789185929.024886:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185929.024947:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a7447d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522af expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025019:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025033:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025044:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025094:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025101:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025109:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025399:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a74492 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025410:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a74492 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025418:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a74492 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185929.025441:0:17156:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789185929.025754:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025763:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025769:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025776:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185929.025780:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025787:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025798:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f2f28ee800) 00010000:00010000:3.0:1789185929.025802:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185929.025806:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025813:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a74484 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025826:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025832:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025838:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025855:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dbc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185929.025858:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025872:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025880:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98f2f28eee00) 00010000:00010000:3.0:1789185929.025883:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185929.025886:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.025891:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7448b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.027624:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a7447d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522af expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.027662:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dba00/0xda5c730d5a74492 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522af expref: 9 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.027692:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f2f28ee900) 00010000:00010000:2.0:1789185929.027695:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185929.027700:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dba00, rc 0) 00000100:00100000:2.0:1789185929.027799:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:15568:x1876096879557760:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 2947us (3472us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789185929.027809:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:3.0:1789185929.032581:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185929.032856:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879557888 00000100:00100000:0.0:1789185929.032866:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879557888 00000100:00100000:0.0:1789185929.032959:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:0.0:1789185929.032969:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:15568:x1876096879557888:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789185929.033072:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:15568:x1876096879557888:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 Request processed in 104us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185929.033080:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:1.0:1789185929.038046:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185929.038166:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879558016 00000100:00100000:0.0:1789185929.038181:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879558016 00000100:00100000:0.0:1789185929.038297:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:0.0:1789185929.038311:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:15568:x1876096879558016:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1789185929.038473:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1789185929.040242:0:17157:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1869us 00000040:00080000:0.0:1789185929.067205:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789185929.076462:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:15568:x1876096879558016:12345-192.168.204.48@tcp:59:lhsmtool_posix.0 Request processed in 38137us (38413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.076483:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:0.0:1789185929.077873:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.078104:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879558144 00000100:00100000:3.0:1789185929.078117:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879558144 00000100:00100000:3.0:1789185929.078191:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:3.0:1789185929.078203:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:15574:x1876096879558144:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185929.078228:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185929.078256:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522b6 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078340:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078356:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078387:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078406:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078414:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078733:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078790:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078799:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078805:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078811:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185929.078816:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078824:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078837:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2c4f8dd00) 00010000:00010000:3.0:1789185929.078840:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185929.078845:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078858:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078874:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078880:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078886:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078890:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185929.078893:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078899:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078951:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f2f28eee00) 00010000:00010000:3.0:1789185929.078954:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185929.078957:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078963:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.078999:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522b6 expref: 10 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.079021:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2c4f8dd00) 00010000:00010000:3.0:1789185929.079024:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185929.079027:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522b6 expref: 10 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.079037:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dbc00, rc 0) 00000100:00100000:3.0:1789185929.079108:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:15574:x1876096879558144:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 907us (1243us total) trans 0 rc 301/301 00000100:00100000:3.0:1789185929.079115:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:0.0:1789185929.084378:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185929.084797:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879558272 00000100:00100000:1.0:1789185929.084812:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879558272 00000100:00100000:1.0:1789185929.084886:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:1.0:1789185929.084898:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:15574:x1876096879558272:12345-192.168.204.48@tcp:700:lfs.0 00000100:00100000:1.0:1789185929.085036:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:15574:x1876096879558272:12345-192.168.204.48@tcp:700:lfs.0 Request processed in 140us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185929.085045:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:1.0:1789185929.088727:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.088944:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879558528 00000100:00100000:3.0:1789185929.088960:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879558528 00000100:00100000:3.0:1789185929.089039:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:3.0:1789185929.089051:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:15574:x1876096879558528:12345-192.168.204.48@tcp:36:lfs.0 00010000:00010000:3.0:1789185929.089250:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185929.089285:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a743ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52223 expref: 9 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.089310:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2c4f8dd00) 00010000:00010000:3.0:1789185929.089317:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185929.089397:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.089415:0:17156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52293 expref: 5 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.089440:0:17156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.089622:0:17156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52293 expref: 5 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.089639:0:17156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52293 expref: 5 pid: 18686 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185929.089658:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1876096898524544:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185929.089894:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185929.094499:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.094786:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1876096898524544:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185929.094823:0:17156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185929.094952:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879558656 00000100:00100000:1.0:1789185929.094962:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879558656 00010000:00010000:1.0:1789185929.095082:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52293 expref: 6 pid: 18686 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185929.095126:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:1.0:1789185929.095139:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2391:x1876096879558656:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185929.095159:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185929.095167:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52293 expref: 6 pid: 18686 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185929.095181:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52293 expref: 6 pid: 18686 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185929.095225:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9200/0xda5c730d5a7440d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52293 expref: 6 pid: 18686 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185929.095244:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2c4f8dd00) 00010000:00010000:1.0:1789185929.095250:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185929.095262:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185929.095270:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185929.095328:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185929.095341:0:17156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.095349:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.095378:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.095389:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.095397:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185929.095418:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2391:x1876096879558656:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 274us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185929.095436:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00080000:2.0:1789185929.095468:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789185929.098669:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.098710:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.098725:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185929.098761:0:17156:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000522e4736 reply state 00000000ea694388 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.098773:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.098781:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:3.0:1789185929.098784:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185929.098788:0:17156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789185929.098795:0:17156:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789185929.098804:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.098810:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.099040:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.099047:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dbc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185929.099052:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.099059:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.099082:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f2c4f8dd00) 00010000:00010000:3.0:1789185929.099084:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185929.099089:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.099095:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a744b5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185929.099118:0:17156:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000522e4736 reply state 00000000ea694388 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.099127:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.099133:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f2f28eee00) 00010000:00010000:3.0:1789185929.099135:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185929.099137:0:17156:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789185929.099490:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+10:15574:x1876096879558528:12345-192.168.204.48@tcp:36:lfs.0 Request processed in 10436us (10777us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789185929.099500:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:0.0:1789185929.260882:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.263356:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879558784 00000100:00100000:3.0:1789185929.263372:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879558784 00000100:00100000:2.0:1789185929.263624:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00100000:2.0:1789185929.263636:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+10:15582:x1876096879558784:12345-192.168.204.48@tcp:101:lctl.0 00010000:00010000:2.0:1789185929.263662:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185929.263683:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a744ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522bd expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.263967:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a744d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.263983:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a744d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.263995:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a744d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185929.264043:0:17155:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789185929.264061:0:17155:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185929.264100:0:17155:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a744d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.264124:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a744ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522bd expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.264142:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e200/0xda5c730d5a744d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522bd expref: 11 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.264151:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:2.0:1789185929.264154:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185929.264157:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402e200, rc 0) 00000100:00100000:2.0:1789185929.264229:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+11:15582:x1876096879558784:12345-192.168.204.48@tcp:101:lctl.0 Request processed in 594us (3356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.264236:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00100000:1.0:1789185929.290059:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.290157:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879558912 00000100:00100000:2.0:1789185929.290166:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879558912 00000100:00100000:2.0:1789185929.290230:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 30 00000100:00100000:2.0:1789185929.290239:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:15583:x1876096879558912:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185929.290258:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185929.290276:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a744d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522c4 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.290338:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a744df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.290351:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a744df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.290379:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a744df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185929.290556:0:17157:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789185929.290560:0:17157:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185929.290584:0:17157:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a744df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.290610:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a744d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522c4 expref: 7 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.290628:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402f400/0xda5c730d5a744df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522c4 expref: 6 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.290637:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:2.0:1789185929.290640:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185929.290644:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c402f400, rc 0) 00000100:00100000:2.0:1789185929.290787:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15583:x1876096879558912:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 547us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.290794:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 30 00000100:00100000:0.0:1789185929.296427:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.296511:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879559040 00000100:00100000:2.0:1789185929.296521:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879559040 00000100:00100000:2.0:1789185929.296577:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:2.0:1789185929.296587:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:15583:x1876096879559040:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185929.296606:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185929.296624:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a744e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522cb expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296710:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296723:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296733:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296745:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296752:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296758:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296851:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a744fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296859:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a744fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296865:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a744fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185929.296904:0:17155:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789185929.296930:0:17155:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185929.296950:0:17155:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a744fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296973:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296979:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296986:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.296992:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c402fa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185929.296996:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297004:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297015:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:2.0:1789185929.297018:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185929.297023:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297029:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402fa00/0xda5c730d5a744ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297040:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297046:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297052:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297063:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185929.297066:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297072:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297080:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f2f28eee00) 00010000:00010000:2.0:1789185929.297082:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185929.297085:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297091:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a744f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297118:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c402e400/0xda5c730d5a744e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522cb expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297131:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a744fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522cb expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.297137:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:2.0:1789185929.297139:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185929.297142:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddea00, rc 0) 00000100:00100000:2.0:1789185929.297207:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+7:15583:x1876096879559040:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 621us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.297214:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:0.0:1789185929.299959:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.300178:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879559168 00000100:00100000:3.0:1789185929.300196:0:17166:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879559168 00000100:00100000:3.0:1789185929.300303:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:3.0:1789185929.300316:0:17166:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:15583:x1876096879559168:12345-192.168.204.48@tcp:900:lfs.0 00000100:00080000:0.0:1789185929.300372:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789185929.300449:0:17166:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:15583:x1876096879559168:12345-192.168.204.48@tcp:900:lfs.0 Request processed in 135us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185929.300459:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:1.0:1789185929.310453:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.310623:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879559424 00000100:00100000:3.0:1789185929.310637:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879559424 00000100:00100000:3.0:1789185929.310717:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 32 00000100:00100000:3.0:1789185929.310729:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+7:15583:x1876096879559424:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185929.310763:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185929.310791:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74502 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522d2 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185929.310997:0:17156:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789185929.311136:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74502 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522d2 expref: 9 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.311152:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:3.0:1789185929.311155:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185929.311161:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74502 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522d2 expref: 9 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.311178:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dbc00, rc 0) 00000100:00100000:3.0:1789185929.311255:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+8:15583:x1876096879559424:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 528us (836us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789185929.311263:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 32 00000100:00100000:0.0:1789185929.316626:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.316750:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879559680 00000100:00100000:2.0:1789185929.316775:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879559680 00000100:00100000:2.0:1789185929.316852:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:2.0:1789185929.316862:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+8:15583:x1876096879559680:12345-192.168.204.48@tcp:36:lfs.0 00010000:00010000:2.0:1789185929.316956:0:17155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185929.316989:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a744fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522cb expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.317009:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:2.0:1789185929.317015:0:17155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185929.317037:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.317050:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.317059:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185929.317257:0:17155:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e8d5b9d4 reply state 00000000c5824d9b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.317269:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.317275:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:2.0:1789185929.317277:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789185929.317280:0:17155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789185929.317287:0:17155:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789185929.317367:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+9:15583:x1876096879559680:12345-192.168.204.48@tcp:36:lfs.0 Request processed in 507us (752us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789185929.317375:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 33 00000100:00100000:0.0:1789185929.325260:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.325380:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879559936 00000100:00100000:3.0:1789185929.325405:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879559936 00000100:00100000:3.0:1789185929.325472:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:3.0:1789185929.325483:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+9:15583:x1876096879559936:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:3.0:1789185929.325708:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+10:15583:x1876096879559936:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 217us (448us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789185929.325732:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:1.0:1789185929.337557:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.337731:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879560192 00000100:00100000:2.0:1789185929.337742:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879560192 00000100:00100000:2.0:1789185929.337802:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 34 00000100:00100000:2.0:1789185929.337812:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+10:15583:x1876096879560192:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185929.337839:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185929.337861:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522d9 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338079:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338094:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338105:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338114:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338120:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338126:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185929.338234:0:17157:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789185929.338303:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338310:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338332:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338338:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfe00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185929.338342:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338349:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338361:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:2.0:1789185929.338364:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185929.338369:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338376:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a7451e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338475:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338483:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338488:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338492:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddee00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185929.338495:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338510:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338519:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f2f28eee00) 00010000:00010000:2.0:1789185929.338521:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185929.338524:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338530:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74525 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338563:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74517 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522d9 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338573:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:2.0:1789185929.338575:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185929.338579:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522d9 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.338588:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddea00, rc 0) 00000100:00100000:2.0:1789185929.338782:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+11:15583:x1876096879560192:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 970us (1235us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789185929.338790:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 34 00000100:00100000:1.0:1789185929.342637:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.342732:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879560320 00000100:00100000:2.0:1789185929.342742:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879560320 00000100:00100000:2.0:1789185929.342803:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 35 00000100:00100000:2.0:1789185929.342815:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+11:15583:x1876096879560320:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185929.342855:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185929.342876:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74533 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522e0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.343018:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.343034:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.343045:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185929.343069:0:17155:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789185929.343073:0:17155:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185929.343092:0:17155:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.343119:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74533 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e0 expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.343137:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e0 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.343145:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:2.0:1789185929.343147:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789185929.343151:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf400, rc 0) 00000100:00100000:2.0:1789185929.343217:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+12:15583:x1876096879560320:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 405us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.343224:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 35 00000100:00100000:0.0:1789185929.350049:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.350166:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879560448 00000100:00100000:3.0:1789185929.350178:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879560448 00000100:00100000:3.0:1789185929.350236:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:3.0:1789185929.350246:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+12:15583:x1876096879560448:12345-192.168.204.48@tcp:37:lfs.0 00000100:00100000:2.0:1789185929.356504:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1735a8d-9a99-4c85-bc30-d3542203dc16+12:15583:x1876096879560448:12345-192.168.204.48@tcp:37:lfs.0 Request processed in 6249us (6456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.356517:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:1.0:1789185929.362263:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185929.362356:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879560704 00000100:00100000:0.0:1789185929.362367:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879560704 00000100:00100000:0.0:1789185929.362454:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:0.0:1789185929.362465:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c7fa1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+12:15583:x1876096879560704:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:0.0:1789185929.362688:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c7fa1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+13:15583:x1876096879560704:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 224us (433us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789185929.362811:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 4 00000100:00100000:3.0:1789185929.467018:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.467959:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879560832 00000100:00100000:2.0:1789185929.467971:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879560832 00000100:00100000:2.0:1789185929.468045:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 36 00000100:00100000:2.0:1789185929.468056:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+11:15589:x1876096879560832:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185929.468077:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185929.468110:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522e7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468175:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468190:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468202:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468214:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468220:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468225:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468303:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a74556 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468329:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a74556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468337:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a74556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185929.468372:0:17156:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789185929.468376:0:17156:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185929.468699:0:17156:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a74556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468714:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468721:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468727:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468733:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddea00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185929.468737:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468745:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468757:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:2.0:1789185929.468760:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185929.468765:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468780:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a74548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468794:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468799:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468803:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468808:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddee00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185929.468810:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468870:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468879:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f2f28eee00) 00010000:00010000:2.0:1789185929.468881:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185929.468884:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468889:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7454f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468957:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e7 expref: 13 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468972:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfe00/0xda5c730d5a74556 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e7 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.468987:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:2.0:1789185929.468989:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789185929.468992:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddfe00, rc 0) 00000100:00100000:2.0:1789185929.469067:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+12:15589:x1876096879560832:12345-192.168.204.48@tcp:101:bash.0 Request processed in 1012us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.469075:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 36 00000100:00100000:1.0:1789185929.473542:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.473614:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879560960 00000100:00100000:2.0:1789185929.473623:0:17167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879560960 00000100:00100000:2.0:1789185929.473677:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:2.0:1789185929.473686:0:17167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:15589:x1876096879560960:12345-192.168.204.48@tcp:900:bash.0 00000100:00100000:2.0:1789185929.473768:0:17167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:15589:x1876096879560960:12345-192.168.204.48@tcp:900:bash.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.473775:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:1.0:1789185929.477650:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.477733:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879561216 00000100:00100000:2.0:1789185929.477744:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879561216 00000100:00100000:2.0:1789185929.477803:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 37 00000100:00100000:2.0:1789185929.477814:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d2fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+12:15589:x1876096879561216:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185929.477846:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185929.477866:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7455d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522ee expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.478011:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.478027:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e0 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.478049:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.478084:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e0 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.478097:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e0 expref: 12 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185929.478110:0:17155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17155:1876096898524672:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185929.478194:0:17155:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2fcbef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789185929.482029:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.482488:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879561344 00000100:00100000:3.0:1789185929.482498:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879561344 00010000:00010000:3.0:1789185929.482540:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e0 expref: 13 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185929.482585:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 16 00000100:00100000:3.0:1789185929.482594:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+13:2391:x1876096879561344:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185929.482609:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185929.482616:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e0 expref: 13 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.482630:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e0 expref: 13 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.482652:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:3.0:1789185929.482658:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.482668:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.482693:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.482713:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185929.482774:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+13:2391:x1876096879561344:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 180us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185929.482780:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 16 00010000:00010000:2.0:1789185929.483975:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a7453a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522e0 expref: 12 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185929.483995:0:17155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17155:1876096898524672:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185929.484018:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484027:0:17155:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484033:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484056:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484066:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484097:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484575:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484586:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484593:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185929.484604:0:17155:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789185929.484628:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484635:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484640:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484646:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185929.484650:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484657:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484667:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:2.0:1789185929.484670:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185929.484681:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484687:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74564 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185929.484697:0:17155:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000012e7769 reply state 00000000fe996f50 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484707:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484712:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f1c33d9b00) 00010000:00010000:2.0:1789185929.484714:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185929.484717:0:17155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789185929.484746:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7455d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522ee expref: 15 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484760:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522ee expref: 14 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.484766:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185929.484769:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789185929.484771:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde200, rc 0) 00000100:00100000:2.0:1789185929.484836:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d2fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+15:15589:x1876096879561216:12345-192.168.204.48@tcp:101:bash.0 Request processed in 7022us (7195us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789185929.484844:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 37 00000100:00100000:0.0:1789185929.513672:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.513781:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879561472 00000100:00100000:2.0:1789185929.513791:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879561472 00000100:00100000:2.0:1789185929.513860:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 38 00000100:00100000:2.0:1789185929.513872:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+15:15589:x1876096879561472:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185929.513942:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185929.513966:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74580 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522f5 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.514038:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74587 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.514052:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.514064:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185929.514126:0:17157:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789185929.514131:0:17157:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185929.514152:0:17157:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.514163:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74587 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.514190:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74580 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522f5 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.514208:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74587 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522f5 expref: 16 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.514216:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185929.514219:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185929.514223:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde400, rc 0) 00000100:00100000:2.0:1789185929.514281:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+16:15589:x1876096879561472:12345-192.168.204.48@tcp:101:bash.0 Request processed in 412us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.514289:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 38 00000100:00100000:1.0:1789185929.522155:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185929.522254:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879561728 00000100:00100000:0.0:1789185929.522266:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879561728 00000100:00100000:0.0:1789185929.522328:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:0.0:1789185929.522341:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+16:15589:x1876096879561728:12345-192.168.204.48@tcp:35:bash.0 00000100:00100000:0.0:1789185929.522863:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+17:15589:x1876096879561728:12345-192.168.204.48@tcp:35:bash.0 Request processed in 523us (715us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789185929.522872:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 5 00000100:00100000:3.0:1789185929.638275:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898524800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789185929.638343:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185929.638656:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898524800 00000100:00100000:2.0:1789185929.638664:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898524800 00000100:00100000:2.0:1789185929.638722:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789185929.638731:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898524800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185929.638751:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789185929.638798:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876096898524800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.638805:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789185929.638872:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185929.638949:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876096898524800:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789185929.639202:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185929.639610:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789185929.639621:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898524928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185929.639657:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185929.639777:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898524928 00000100:00100000:2.0:1789185929.639782:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898524928 00000100:00100000:2.0:1789185929.639827:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789185929.639834:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898524928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789185929.639862:0:17896:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789185929.639925:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898524928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185929.639931:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789185929.640106:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898524928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789185929.689544:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.689639:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879561984 00000100:00100000:3.0:1789185929.689650:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879561984 00000100:00100000:3.0:1789185929.689715:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 39 00000100:00100000:3.0:1789185929.689725:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+17:15599:x1876096879561984:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:3.0:1789185929.689752:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185929.689773:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7458e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee522fc expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185929.689873:0:18686:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789185929.690030:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7458e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522fc expref: 19 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.690044:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:3.0:1789185929.690046:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185929.690051:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a7458e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522fc expref: 19 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.690063:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30dbc00, rc 0) 00000100:00100000:3.0:1789185929.690133:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+18:15599:x1876096879561984:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 409us (614us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789185929.690140:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 39 00000100:00100000:3.0:1789185929.695750:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.695845:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879562240 00000100:00100000:2.0:1789185929.695854:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879562240 00000100:00100000:2.0:1789185929.695950:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:2.0:1789185929.695960:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+18:15599:x1876096879562240:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:2.0:1789185929.696192:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+19:15599:x1876096879562240:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 233us (451us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789185929.696200:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 6 00000100:00100000:1.0:1789185929.746886:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.747025:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879562496 00000100:00100000:2.0:1789185929.747036:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879562496 00000100:00100000:2.0:1789185929.747106:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 40 00000100:00100000:2.0:1789185929.747116:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+19:15602:x1876096879562496:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185929.747141:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185929.747163:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7459c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52303 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.747281:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a745a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.747296:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a745a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.747309:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a745a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185929.747321:0:17157:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789185929.747450:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7459c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52303 expref: 22 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.747470:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a745a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52303 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185929.747479:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185929.747481:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185929.747485:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf400, rc 0) 00000100:00100000:2.0:1789185929.747688:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+21:15602:x1876096879562496:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 571us (810us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789185929.747712:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 40 00000100:00100000:1.0:1789185929.753868:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185929.753985:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879562624 00000100:00100000:3.0:1789185929.753996:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879562624 00000100:00100000:3.0:1789185929.754058:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:3.0:1789185929.754068:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+21:15602:x1876096879562624:12345-192.168.204.48@tcp:54:lfs.0 00010000:00010000:3.0:1789185929.754149:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.754167:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.754180:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.754226:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.754234:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.754256:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.754261:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dbc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185929.754266:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.754272:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.754283:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185929.754286:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789185929.754291:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185929.754297:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185929.754375:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+21:15602:x1876096879562624:12345-192.168.204.48@tcp:54:lfs.0 Request processed in 308us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185929.754383:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 41 00000100:00100000:0.0:1789185929.757404:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185929.757558:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879562752 00000100:00100000:1.0:1789185929.757581:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879562752 00000100:00100000:1.0:1789185929.757651:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:1.0:1789185929.757662:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+21:2391:x1876096879562752:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185929.757678:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185929.757701:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf400/0xda5c730d5a745a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52303 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185929.757719:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:1.0:1789185929.757724:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185929.757787:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+20:2391:x1876096879562752:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 126us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185929.757795:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:1.0:1789185929.761722:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185929.761811:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879563008 00000100:00100000:2.0:1789185929.761821:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879563008 00000100:00100000:2.0:1789185929.761876:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 7 00000100:00100000:2.0:1789185929.761885:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+20:15602:x1876096879563008:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:2.0:1789185929.762139:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+21:15602:x1876096879563008:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 254us (426us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789185929.762147:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 7 00000040:00080000:3.0:1789185929.831792:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789185930.083769:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185930.083880:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879563264 00000100:00100000:2.0:1789185930.083890:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879563264 00000100:00100000:2.0:1789185930.083975:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:2.0:1789185930.083983:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+21:15633:x1876096879563264:12345-192.168.204.48@tcp:101:cat.0 00010000:00010000:2.0:1789185930.084008:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185930.084028:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5230a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.084135:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a745bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.084150:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a745bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.084162:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a745bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185930.084173:0:17157:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789185930.084285:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5230a expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.084314:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a745bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5230a expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.084322:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185930.084325:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185930.084328:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf200, rc 0) 00000100:00100000:2.0:1789185930.084397:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+23:15633:x1876096879563264:12345-192.168.204.48@tcp:101:cat.0 Request processed in 414us (637us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789185930.084985:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 42 00000100:00100000:3.0:1789185930.088215:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185930.088275:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879563520 00000100:00100000:2.0:1789185930.088286:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879563520 00000100:00100000:3.0:1789185930.088288:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185930.088382:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879563648 00000100:00100000:1.0:1789185930.088388:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879563648 00000100:00100000:2.0:1789185930.088448:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:1.0:1789185930.088451:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 1 00000100:00100000:2.0:1789185930.088459:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+24:15633:x1876096879563520:12345-192.168.204.48@tcp:35:cat.0 00000100:00100000:1.0:1789185930.088459:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+24:2390:x1876096879563648:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185930.088476:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185930.088503:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf200/0xda5c730d5a745bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5230a expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185930.088533:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:1.0:1789185930.088538:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185930.088593:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+23:2390:x1876096879563648:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 135us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185930.088600:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 1 00000100:00100000:2.0:1789185930.088957:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+23:15633:x1876096879563520:12345-192.168.204.48@tcp:35:cat.0 Request processed in 499us (753us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789185930.088964:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 8 00000100:00100000:0.0:1789185930.152323:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789185930.152347:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898525056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789185930.152435:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185930.152532:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898525056 00000100:00100000:2.0:1789185930.152541:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898525056 00000100:00100000:2.0:1789185930.152603:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789185930.152614:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898525056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185930.152656:0:17161:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789185930.152723:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876096898525056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185930.152729:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789185930.152986:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898525056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185930.192881:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185930.193010:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879563904 00000100:00100000:3.0:1789185930.193030:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879563904 00000100:00100000:3.0:1789185930.193319:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 43 00000100:00100000:3.0:1789185930.193330:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+23:15639:x1876096879563904:12345-192.168.204.48@tcp:101:dd.0 00010000:00010000:3.0:1789185930.193353:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185930.193385:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745cd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52311 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.193508:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a745d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.194422:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a745d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.194441:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a745d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789185930.194458:0:18686:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789185930.195475:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a745cd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52311 expref: 26 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.195499:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a745d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52311 expref: 25 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.195507:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185930.195510:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789185930.195514:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db000, rc 0) 00000100:00100000:3.0:1789185930.196076:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+25:15639:x1876096879563904:12345-192.168.204.48@tcp:101:dd.0 Request processed in 2739us (3196us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789185930.196086:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 43 00000100:00100000:0.0:1789185930.202422:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185930.202476:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879564032 00000100:00100000:3.0:1789185930.202487:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879564032 00000100:00100000:3.0:1789185930.202568:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:3.0:1789185930.202579:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+25:2392:x1876096879564032:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185930.202612:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185930.202639:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a745d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52311 expref: 25 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.202660:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185930.202664:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185930.203705:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+24:2392:x1876096879564032:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 1121us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185930.203715:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 2 00000100:00100000:0.0:1789185930.207447:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185930.207619:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879564160 00000100:00100000:2.0:1789185930.207644:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879564160 00000100:00100000:2.0:1789185930.207709:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 44 00000100:00100000:2.0:1789185930.207720:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+24:15639:x1876096879564160:12345-192.168.204.48@tcp:101:dd.0 00010000:00010000:2.0:1789185930.207746:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185930.207767:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52318 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.207805:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.207831:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.207843:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.207984:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52318 expref: 26 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.208003:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52318 expref: 25 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.208016:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185930.208020:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789185930.208023:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde800, rc 0) 00000100:00100000:2.0:1789185930.208090:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+25:15639:x1876096879564160:12345-192.168.204.48@tcp:101:dd.0 Request processed in 371us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185930.208096:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 44 00000100:00100000:0.0:1789185930.213944:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185930.214524:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879564416 00000100:00100000:2.0:1789185930.214549:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879564416 00000100:00100000:2.0:1789185930.214671:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 45 00000100:00100000:2.0:1789185930.214683:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+25:15639:x1876096879564416:12345-192.168.204.48@tcp:36:dd.0 00010000:00010000:2.0:1789185930.214754:0:17155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185930.214781:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74587 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522f5 expref: 25 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.214800:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185930.214805:0:17155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185930.215007:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.215030:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.215041:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185930.215084:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789185930.215108:0:17155:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f252caed reply state 000000000b401896 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.215134:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.215141:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185930.215144:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185930.215146:0:17155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185930.215244:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+27:15639:x1876096879564416:12345-192.168.204.48@tcp:36:dd.0 Request processed in 564us (1338us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789185930.215252:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 45 00000020:00080000:2.0:1789185930.215264:0:17155:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789185930.360586:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185930.360859:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879564672 00000100:00100000:1.0:1789185930.360871:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879564672 00000100:00100000:1.0:1789185930.360972:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:1.0:1789185930.360983:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+27:15639:x1876096879564672:12345-192.168.204.48@tcp:35:dd.0 00000100:00100000:1.0:1789185930.361250:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+28:15639:x1876096879564672:12345-192.168.204.48@tcp:35:dd.0 Request processed in 269us (674us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1789185930.361258:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 9 00000100:00100000:0.0:1789185930.625536:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185930.625643:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879564800 00000100:00100000:2.0:1789185930.625655:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879564800 00000100:00100000:2.0:1789185930.625722:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 46 00000100:00100000:2.0:1789185930.625733:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+28:15653:x1876096879564800:12345-192.168.204.48@tcp:101:stat.0 00010000:00010000:2.0:1789185930.625759:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185930.625781:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a745f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5231f expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.625858:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.625873:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.625884:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.625895:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.625902:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.625942:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626021:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a7460c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626031:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a7460c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626057:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a7460c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185930.626099:0:17157:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789185930.626103:0:17157:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185930.626158:0:17157:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a7460c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626172:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a7460c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626180:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626187:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626194:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626200:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddee00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185930.626204:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626211:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626223:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:2.0:1789185930.626226:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185930.626231:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626247:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a745fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626260:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626265:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626485:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626492:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185930.626496:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626503:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626512:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f1c33d9b00) 00010000:00010000:2.0:1789185930.626514:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185930.626518:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626524:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74605 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626555:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a745f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5231f expref: 30 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626568:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a7460c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5231f expref: 29 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.626582:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185930.626584:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185930.626587:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddf600, rc 0) 00000100:00100000:2.0:1789185930.626655:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+29:15653:x1876096879564800:12345-192.168.204.48@tcp:101:stat.0 Request processed in 924us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185930.626663:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 46 00010000:00010000:2.0:1789185930.662456:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789185930.711984:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185930.712110:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879565056 00000100:00100000:3.0:1789185930.712125:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879565056 00000100:00100000:3.0:1789185930.712205:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 47 00000100:00100000:3.0:1789185930.712218:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+29:15659:x1876096879565056:12345-192.168.204.48@tcp:36:truncate.0 00010000:00010000:3.0:1789185930.712294:0:18686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185930.712330:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf600/0xda5c730d5a7460c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5231f expref: 29 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.712354:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185930.712360:0:18686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789185930.712635:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.712653:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.712664:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185930.712745:0:18686:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1789185930.712773:0:18686:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000044a12847 reply state 000000008da84f64 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.712787:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185930.712794:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185930.712797:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185930.712800:0:18686:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185930.713031:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+31:15659:x1876096879565056:12345-192.168.204.48@tcp:36:truncate.0 Request processed in 814us (1061us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789185930.713040:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 47 00000020:00080000:3.0:1789185930.713046:0:18686:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789185930.891278:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185930.891970:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879565184 00000100:00100000:2.0:1789185930.891986:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879565184 00000100:00100000:2.0:1789185930.892131:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 48 00000100:00100000:2.0:1789185930.892145:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+31:15673:x1876096879565184:12345-192.168.204.48@tcp:101:stat.0 00010000:00010000:2.0:1789185930.892181:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185930.892209:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a7461a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52326 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.892304:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.892323:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.892340:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.892721:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.892731:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.892770:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.892992:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893002:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893011:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185930.893145:0:17157:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789185930.893151:0:17157:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185930.893178:0:17157:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893193:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893203:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893211:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893218:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893224:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185930.893230:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893248:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893263:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:2.0:1789185930.893267:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185930.893274:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893281:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf000/0xda5c730d5a74621 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893300:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893306:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893311:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893316:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddee00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185930.893319:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893326:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.893334:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f1c33d9b00) 00010000:00010000:2.0:1789185930.893336:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185930.893339:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.894225:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a74628 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.894283:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a7461a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52326 expref: 33 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.894301:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52326 expref: 32 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.894310:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185930.894313:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185930.894316:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddfa00, rc 0) 00000100:00100000:2.0:1789185930.894450:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+32:15673:x1876096879565184:12345-192.168.204.48@tcp:101:stat.0 Request processed in 2306us (3186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185930.894460:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 48 00000100:00100000:0.0:1789185930.979617:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185930.982249:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879565440 00000100:00100000:2.0:1789185930.982270:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879565440 00000100:00100000:2.0:1789185930.982374:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 49 00000100:00100000:2.0:1789185930.982398:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+32:15683:x1876096879565440:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:2.0:1789185930.982427:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185930.982465:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5232d expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185930.982600:0:17155:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789185930.982732:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74636 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5232d expref: 34 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.982771:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:2.0:1789185930.982774:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789185930.982781:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde400/0xda5c730d5a74636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5232d expref: 34 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185930.982799:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300dde400, rc 0) 00000100:00100000:2.0:1789185930.985277:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+33:15683:x1876096879565440:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 2873us (5659us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1789185930.985295:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 49 00000100:00100000:0.0:1789185930.996654:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185930.996781:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879565696 00000100:00100000:1.0:1789185930.996795:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879565696 00000100:00100000:1.0:1789185930.996935:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:1.0:1789185930.996949:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2c7fa0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+33:15683:x1876096879565696:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:1.0:1789185930.997870:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2c7fa0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+34:15683:x1876096879565696:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 916us (1358us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789185930.997882:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 10 00000100:00100000:0.0:1789185931.116116:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185931.116270:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879565952 00000100:00100000:3.0:1789185931.116283:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879565952 00000100:00100000:3.0:1789185931.116368:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 50 00000100:00100000:3.0:1789185931.116380:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+34:15689:x1876096879565952:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185931.116424:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185931.116450:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74644 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52334 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.116600:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.116618:0:17156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522ee expref: 35 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.116650:0:17156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52326 expref: 35 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.116659:0:17156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.116700:0:17156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52326 expref: 35 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.116714:0:17156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52326 expref: 35 pid: 17157 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185931.116730:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1876096898525184:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185931.116848:0:17156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522ee expref: 35 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.116858:0:17156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522ee expref: 35 pid: 17155 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185931.116867:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1876096898525312:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185931.116890:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1fac00 going to sleep for 11 seconds 00000100:00080000:0.0:1789185931.117886:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789185931.121737:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185931.121894:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1876096898525184:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185931.121944:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17156:1876096898525312:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185931.121980:0:17156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185931.122234:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185931.126183:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879566208 00000100:00100000:1.0:1789185931.126209:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879566208 00010000:00010000:1.0:1789185931.126285:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522ee expref: 36 pid: 17155 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185931.126346:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879566080 00000100:00100000:1.0:1789185931.126350:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879566080 00010000:00010000:1.0:1789185931.126365:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52326 expref: 37 pid: 17157 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185931.126504:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:1.0:1789185931.126519:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+37:2391:x1876096879566208:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185931.126568:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185931.126578:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522ee expref: 37 pid: 17155 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185931.126593:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522ee expref: 37 pid: 17155 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185931.126624:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde200/0xda5c730d5a74572 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee522ee expref: 37 pid: 17155 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185931.126645:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:1.0:1789185931.126652:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185931.126664:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185931.126673:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185931.126762:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+36:2391:x1876096879566208:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 247us (5041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185931.128083:0:17141:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789185931.128106:0:17141:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789185931.132278:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 18 00000100:00100000:2.0:1789185931.132311:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+36:2391:x1876096879566080:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789185931.132342:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185931.132358:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52326 expref: 36 pid: 17157 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.132402:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52326 expref: 36 pid: 17157 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.132436:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a7462f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52326 expref: 36 pid: 17157 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.132457:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185931.132465:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.132500:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.132509:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.132547:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185931.132637:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+35:2391:x1876096879566080:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 340us (10404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185931.132646:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 18 00010000:00010000:2.0:1789185931.132698:0:17156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.132707:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185931.132730:0:17156:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789185931.132946:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dbc00/0xda5c730d5a74644 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52334 expref: 36 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.132964:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52334 expref: 35 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.132972:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185931.132974:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789185931.132977:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c30db600, rc 0) 00000100:00100000:2.0:1789185931.133006:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+35:15689:x1876096879565952:12345-192.168.204.48@tcp:101:bash.0 Request processed in 16629us (16907us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789185931.133034:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 50 00000100:00100000:1.0:1789185931.134604:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 17 00000100:00100000:0.0:1789185931.139723:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185931.139822:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879566464 00000100:00100000:3.0:1789185931.139836:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879566464 00000100:00100000:3.0:1789185931.140246:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 51 00000100:00100000:3.0:1789185931.140261:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+34:15689:x1876096879566464:12345-192.168.204.48@tcp:36:bash.0 00010000:00010000:3.0:1789185931.140688:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.140711:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.140726:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185931.140783:0:18686:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1789185931.140804:0:18686:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cead1a48 reply state 00000000f4a91a24 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.140820:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.140827:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185931.140831:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789185931.140836:0:18686:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789185931.141243:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+37:15689:x1876096879566464:12345-192.168.204.48@tcp:36:bash.0 Request processed in 983us (1531us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1789185931.141252:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 51 00000020:00080000:3.0:1789185931.141258:0:18686:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789185931.144667:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185931.144775:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879566592 00000100:00100000:0.0:1789185931.144787:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879566592 00000100:00100000:0.0:1789185931.144883:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:0.0:1789185931.144896:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+37:15689:x1876096879566592:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185931.144975:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185931.145001:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a74660 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5233b expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.145342:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a74660 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5233b expref: 38 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.145363:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a74660 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5233b expref: 38 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.145458:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:0.0:1789185931.145462:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185931.145468:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0030200, rc 0) 00000100:00100000:0.0:1789185931.145550:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+38:15689:x1876096879566592:12345-192.168.204.48@tcp:101:bash.0 Request processed in 656us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185931.145558:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 52 00000100:00100000:0.0:1789185931.151962:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185931.152197:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879566720 00000100:00100000:2.0:1789185931.152212:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879566720 00000100:00100000:2.0:1789185931.152291:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 53 00000100:00100000:2.0:1789185931.152303:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+38:15689:x1876096879566720:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:2.0:1789185931.152331:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789185931.152358:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74667 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52342 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.152493:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.152512:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52334 expref: 39 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.152534:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.152581:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52334 expref: 39 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.152597:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52334 expref: 39 pid: 17156 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185931.152614:0:17155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4153800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17155:1876096898525440:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185931.153190:0:17155:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2fcbef240 going to sleep for 11 seconds 00000100:00100000:3.0:1789185931.156656:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185931.156884:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879566848 00000100:00100000:0.0:1789185931.156898:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879566848 00010000:00010000:0.0:1789185931.156981:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52334 expref: 40 pid: 17156 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185931.157042:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 19 00000100:00100000:0.0:1789185931.157063:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+40:2391:x1876096879566848:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185931.157083:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185931.157091:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52334 expref: 40 pid: 17156 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.157129:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52334 expref: 40 pid: 17156 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.157157:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:0.0:1789185931.157164:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.157177:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.157186:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.157215:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185931.157298:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+40:2391:x1876096879566848:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 245us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185931.157306:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 19 00010000:00010000:2.0:1789185931.158001:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db600/0xda5c730d5a7464b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52334 expref: 39 pid: 17156 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185931.158035:0:17155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4153800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17155:1876096898525440:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185931.158072:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.158082:0:17155:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.158088:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185931.158155:0:17155:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789185931.158160:0:17155:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185931.158185:0:17155:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.158224:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74667 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52342 expref: 39 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.158240:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52342 expref: 38 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.158248:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185931.158251:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789185931.158254:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f300ddee00, rc 0) 00000100:00100000:2.0:1789185931.158314:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+38:15689:x1876096879566720:12345-192.168.204.48@tcp:101:bash.0 Request processed in 6014us (6366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185931.158322:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 53 00000100:00100000:3.0:1789185931.162184:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185931.164003:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879567104 00000100:00100000:0.0:1789185931.164023:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879567104 00000100:00100000:0.0:1789185931.164126:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:0.0:1789185931.164139:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+38:15689:x1876096879567104:12345-192.168.204.48@tcp:103:bash.0 00010000:00010000:0.0:1789185931.164160:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789185931.164191:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a74660 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5233b expref: 38 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.164219:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7466e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52342 expref: 37 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185931.164261:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:0.0:1789185931.164268:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789185931.164523:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+36:15689:x1876096879567104:12345-192.168.204.48@tcp:103:bash.0 Request processed in 386us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185931.164532:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 3 00000100:00100000:0.0:1789185931.168125:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185931.168327:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879567232 00000100:00100000:2.0:1789185931.168344:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879567232 00000100:00100000:2.0:1789185931.168862:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 54 00000100:00100000:2.0:1789185931.168874:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+36:15689:x1876096879567232:12345-192.168.204.48@tcp:58:bash.0 00010000:00010000:2.0:1789185931.169039:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.169071:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185931.169085:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789185931.170310:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789185931.170351:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789185931.170512:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789185931.171044:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+36:15689:x1876096879567232:12345-192.168.204.48@tcp:58:bash.0 Request processed in 2164us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185931.171113:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 54 00000100:00100000:1.0:1789185931.173501:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185931.173834:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879567360 00000100:00100000:3.0:1789185931.173849:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879567360 00000100:00100000:3.0:1789185931.173953:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00100000:3.0:1789185931.173966:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+36:15689:x1876096879567360:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:3.0:1789185931.173993:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789185931.174020:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7467c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52349 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.174094:0:18686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.174106:0:18686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7467c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52349 expref: 37 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.174129:0:18686:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.174144:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7467c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52349 expref: 37 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.174161:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185931.174165:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789185931.174170:0:18686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7467c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52349 expref: 37 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185931.174191:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2ff9c0e00, rc 0) 00000100:00100000:3.0:1789185931.174262:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+37:15689:x1876096879567360:12345-192.168.204.48@tcp:101:bash.0 Request processed in 299us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185931.174287:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 55 00000100:00100000:0.0:1789185931.174330:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898525568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789185931.174565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.174609:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898525568 00000100:00100000:1.0:1789185931.174615:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898525568 00000100:00080000:0.0:1789185931.174642:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789185931.174656:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789185931.174665:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898525568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789185931.174698:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789185931.174741:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898525568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.174755:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789185931.174790:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898525568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789185931.176257:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898525696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789185931.176325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185931.176989:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898525696 00000100:00100000:0.0:1789185931.177001:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898525696 00000100:00100000:0.0:1789185931.177095:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185931.177107:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898525696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789185931.177135:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789185931.177202:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898525696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185931.177210:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789185931.177273:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898525696:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789185931.177904:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789185931.178128:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898525824:0@lo:400:kworker.0 00000100:00100000:0.0:1789185931.178181:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185931.178320:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898525952:0@lo:400:kworker.0 00000100:00100000:3.0:1789185931.178353:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185931.178407:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898525952 00000100:00100000:3.0:1789185931.178414:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898525952 00000100:00100000:3.0:1789185931.178454:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789185931.178461:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898525952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789185931.178504:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876096898525952:12345-0@lo:400:kworker.0 Request processed in 44us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185931.178511:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789185931.178543:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876096898525952:0@lo:400:kworker.0 00000100:00100000:2.0:1789185931.178701:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898525824 00000100:00100000:2.0:1789185931.178706:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898525824 00000100:00100000:2.0:1789185931.178743:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789185931.178751:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3635:x1876096898525824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179024:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898526464:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179067:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.179090:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898526976:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179116:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.179136:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789185931.179142:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898526336:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.179217:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898526848:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179236:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.179264:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898526464 00000100:00100000:1.0:1789185931.179268:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898526464 00000100:00100000:1.0:1789185931.179313:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789185931.179321:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898526464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179359:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898526464:12345-0@lo:400:kworker.0 Request processed in 40us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.179366:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789185931.179404:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185931.179427:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898526464:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179468:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898526208:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179493:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.179512:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898526720:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179533:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.179562:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789185931.179577:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898526080:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179601:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.179620:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898526592:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179646:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.179655:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898527104:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179679:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185931.179712:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898526080 00000100:00100000:1.0:1789185931.179717:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898526080 00000100:00100000:1.0:1789185931.179749:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789185931.179755:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898526080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179790:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898526080:12345-0@lo:400:kworker.0 Request processed in 35us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.179795:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789185931.179808:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185931.179824:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898526080:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.179844:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898526976 00000100:00100000:1.0:1789185931.179847:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898526976 00000100:00100000:1.0:1789185931.179872:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898526848 00000100:00100000:1.0:1789185931.179875:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898526848 00000100:00100000:1.0:1789185931.179888:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898526208 00000100:00100000:1.0:1789185931.179890:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898526208 00000100:00100000:1.0:1789185931.179902:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898526720 00000100:00100000:1.0:1789185931.179904:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898526720 00000100:00100000:1.0:1789185931.179951:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898526592 00000100:00100000:1.0:1789185931.179954:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898526592 00000100:00100000:1.0:1789185931.179962:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898527104 00000100:00100000:1.0:1789185931.179964:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898527104 00000100:00100000:1.0:1789185931.179975:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789185931.179980:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898526976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180018:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876096898526976:12345-0@lo:400:kworker.0 Request processed in 38us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.180024:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789185931.180039:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789185931.180045:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898526848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180069:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876096898526848:12345-0@lo:400:kworker.0 Request processed in 25us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.180074:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789185931.180084:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185931.180088:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898526208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180116:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876096898526208:12345-0@lo:400:kworker.0 Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.180121:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789185931.180129:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789185931.180135:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898526720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180157:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876096898526720:12345-0@lo:400:kworker.0 Request processed in 22us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.180162:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789185931.180171:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789185931.180176:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898526592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180197:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876096898526592:12345-0@lo:400:kworker.0 Request processed in 21us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.180202:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789185931.180211:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789185931.180216:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898527104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180249:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876096898527104:12345-0@lo:400:kworker.0 Request processed in 32us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.180255:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1789185931.180270:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789185931.180273:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789185931.180291:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c411ce00 x1876096898526848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185931.180302:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876096898526848:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180314:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876096898526976:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180337:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876096898526592:0@lo:400:kworker.0 00010000:00080000:1.0:1789185931.180347:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f1c411d180 x1876096898527104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789185947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789185931.180357:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876096898527104:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180368:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876096898526208:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180377:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876096898526720:0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180436:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898526336 00000100:00100000:1.0:1789185931.180441:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898526336 00000100:00100000:1.0:1789185931.180471:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789185931.180477:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898526336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789185931.180511:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898526336:12345-0@lo:400:kworker.0 Request processed in 34us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185931.180517:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789185931.180544:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898526336:0@lo:400:kworker.0 00000100:00100000:2.0:1789185931.181035:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b5e51b6-f73d-464f-892e-c60a26cf0ba7+24:3635:x1876096898525824:12345-0@lo:400:kworker.0 Request processed in 2281us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185931.181101:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789185931.181271:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b5e51b6-f73d-464f-892e-c60a26cf0ba7:3635:1876096898525824:0@lo:400:kworker.0 00010000:00010000:3.0:1789185931.687204:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789185932.135869:0:17191:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789185932.135900:0:17191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789185932.135999:0:17191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789185932.136011:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789185932.136341:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d870d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17191:1876096898527232:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789185932.136489:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2db3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789185932.141557:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d870d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17191:1876096898527232:192.168.204.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789185932.142940:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.143268:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879567488 00000100:00100000:1.0:1789185932.143281:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879567488 00000100:00100000:1.0:1789185932.143377:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00100000:1.0:1789185932.143390:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+37:15691:x1876096879567488:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789185932.143437:0:18686:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789185932.143589:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+37:15691:x1876096879567488:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 201us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.143597:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 56 00000100:00100000:1.0:1789185932.149951:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185932.150154:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879567616 00000100:00100000:2.0:1789185932.150168:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879567616 00000100:00100000:2.0:1789185932.150270:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 57 00000100:00100000:2.0:1789185932.150283:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c34b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+37:15691:x1876096879567616:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789185932.150415:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.150438:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.150454:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.152400:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.152428:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.152441:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.152564:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.152575:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.152581:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789185932.152641:0:17156:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789185932.152646:0:17156:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789185932.152660:0:17156:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.152687:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.152694:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.152700:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153025:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddec00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185932.153029:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153037:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153230:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f2f28ee900) 00010000:00010000:2.0:1789185932.153234:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185932.153240:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153247:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddec00/0xda5c730d5a74683 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153264:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153270:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153277:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153289:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde600 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185932.153293:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153299:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153307:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98f1c33d9c00) 00010000:00010000:2.0:1789185932.153310:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185932.153313:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153318:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a7468a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153334:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153341:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153345:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153350:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfc00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:2.0:1789185932.153353:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153359:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153386:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:2.0:1789185932.153389:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789185932.153392:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.153396:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfc00/0xda5c730d5a74691 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185932.155633:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c34b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+37:15691:x1876096879567616:12345-192.168.204.48@tcp:34:lhsmtool_posix.0 Request processed in 5340us (5727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185932.155649:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 57 00000100:00100000:3.0:1789185932.166714:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.166879:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879567872 00000100:00100000:1.0:1789185932.166894:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879567872 00000100:00100000:1.0:1789185932.166987:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 58 00000100:00100000:1.0:1789185932.166997:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+37:15691:x1876096879567872:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185932.167019:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185932.167038:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a74698 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52350 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167147:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167162:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167186:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185932.167197:0:18686:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789185932.167274:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167298:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167305:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167310:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f1c1bf8000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:1.0:1789185932.167314:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167321:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167333:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:1.0:1789185932.167336:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789185932.167341:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167347:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a7469f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167405:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a74698 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52350 expref: 39 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167415:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f2f28ee900) 00010000:00010000:1.0:1789185932.167418:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789185932.167423:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a74698 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52350 expref: 39 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.167434:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8400, rc 0) 00000100:00100000:1.0:1789185932.168930:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+38:15691:x1876096879567872:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 1906us (2206us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1789185932.168947:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 58 00000100:00100000:3.0:1789185932.176093:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.176401:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879568000 00000100:00100000:0.0:1789185932.176412:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879568000 00000100:00100000:0.0:1789185932.176484:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:0.0:1789185932.176494:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+38:15691:x1876096879568000:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789185932.176532:0:17155:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789185932.176652:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+38:15691:x1876096879568000:12345-192.168.204.48@tcp:53:lhsmtool_posix.0 Request processed in 159us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185932.176660:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 59 00000100:00100000:3.0:1789185932.186840:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.186938:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879568256 00000100:00100000:0.0:1789185932.186947:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879568256 00000100:00100000:0.0:1789185932.187003:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:0.0:1789185932.187012:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+38:15691:x1876096879568256:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789185932.187032:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185932.187053:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52357 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789185932.187601:0:17157:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1789185932.187607:0:17157:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789185932.187625:0:17157:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789185932.187749:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031200/0xda5c730d5a746b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.187762:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031200/0xda5c730d5a746b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.187785:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031200/0xda5c730d5a746b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.187833:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52357 expref: 41 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.187850:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031200/0xda5c730d5a746b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52357 expref: 40 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.187859:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f2c6199700) 00010000:00010000:0.0:1789185932.187862:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789185932.187865:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031200, rc 0) 00000100:00100000:0.0:1789185932.188440:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+40:15691:x1876096879568256:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 1425us (1605us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789185932.188448:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 60 00000100:00100000:3.0:1789185932.203559:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.203723:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879568512 00000100:00100000:0.0:1789185932.203734:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879568512 00000100:00100000:0.0:1789185932.203803:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:0.0:1789185932.203814:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+40:15691:x1876096879568512:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789185932.203872:0:17155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185932.203900:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031200/0xda5c730d5a746b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52357 expref: 40 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.203968:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f2c6199700) 00010000:00010000:0.0:1789185932.203980:0:17155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789185932.204003:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204030:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204042:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204125:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204134:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204141:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204191:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204199:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204206:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204212:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0030200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185932.204216:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204223:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204232:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:0.0:1789185932.204242:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185932.204247:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204254:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0030200/0xda5c730d5a746c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204266:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204272:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204279:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204284:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185932.204287:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204293:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204301:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3d689693 (ffff98f2c6199e00) 00010000:00010000:0.0:1789185932.204305:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185932.204307:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.204313:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3d689693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185932.204410:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+39:15691:x1876096879568512:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 597us (860us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789185932.204424:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 61 00000100:00100000:3.0:1789185932.206870:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.207006:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879568640 00000100:00100000:1.0:1789185932.207016:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879568640 00000100:00100000:1.0:1789185932.207076:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 62 00000100:00100000:1.0:1789185932.207087:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+39:15691:x1876096879568640:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185932.207106:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185932.207130:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5235e expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.207168:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a746d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.207181:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a746d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.207206:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a746d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.207322:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5235e expref: 41 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.207343:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8000/0xda5c730d5a746d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5235e expref: 40 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.207350:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185932.207353:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789185932.207356:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8000, rc 0) 00000100:00100000:1.0:1789185932.207436:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+40:15691:x1876096879568640:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 351us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.207443:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 62 00000100:00100000:3.0:1789185932.222873:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.223587:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879568896 00000100:00100000:0.0:1789185932.223599:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879568896 00000100:00100000:0.0:1789185932.223668:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 63 00000100:00100000:0.0:1789185932.223678:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+40:15691:x1876096879568896:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789185932.223781:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.223797:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.223808:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789185932.224277:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789185932.224289:0:17155:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 571386380778ns, next at 572386378055ns, rc = 0 00000004:00010000:0.0:1789185932.224344:0:17155:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000b2029f8 reply state 00000000ba26fb40 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.224357:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.224378:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:0.0:1789185932.224381:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789185932.224385:0:17155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789185932.224873:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+42:15691:x1876096879568896:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 1192us (2006us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1789185932.224882:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 63 00000100:00100000:3.0:1789185932.229847:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.230312:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879569024 00000100:00100000:1.0:1789185932.230324:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879569024 00000100:00100000:1.0:1789185932.230405:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 64 00000100:00100000:1.0:1789185932.230416:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+42:15691:x1876096879569024:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185932.230441:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185932.230471:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52365 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.230531:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52365 expref: 43 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.230546:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52365 expref: 43 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.230562:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185932.230565:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789185932.230568:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8400, rc 0) 00000100:00100000:1.0:1789185932.230629:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+43:15691:x1876096879569024:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 215us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.230635:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 64 00000100:00100000:2.0:1789185932.234756:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.235693:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879569152 00000100:00100000:1.0:1789185932.235717:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879569152 00000100:00100000:1.0:1789185932.235799:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:1.0:1789185932.235810:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2391:x1876096879569152:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789185932.236126:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789185932.236669:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2391:x1876096879569152:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 857us (1919us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789185932.236677:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:3.0:1789185932.243093:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185932.244877:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879569408 00000100:00100000:2.0:1789185932.244893:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879569408 00000100:00100000:2.0:1789185932.245014:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00100000:2.0:1789185932.245034:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+43:15691:x1876096879569408:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789185932.245401:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+44:15691:x1876096879569408:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 367us (2316us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789185932.245408:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 11 00000100:00100000:2.0:1789185932.257384:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.259315:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879569664 00000100:00100000:0.0:1789185932.259359:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879569664 00000100:00100000:0.0:1789185932.259447:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00100000:0.0:1789185932.259459:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+44:15691:x1876096879569664:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789185932.260499:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+44:15691:x1876096879569664:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 427us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185932.260510:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 65 00000100:00100000:0.0:1789185932.266710:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.269716:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879569792 00000100:00100000:1.0:1789185932.269730:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879569792 00000100:00100000:1.0:1789185932.269858:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 66 00000100:00100000:1.0:1789185932.269870:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+44:15691:x1876096879569792:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185932.269899:0:18686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185932.269942:0:18686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a746ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5236c expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.270016:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8200/0xda5c730d5a746f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.270042:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8200/0xda5c730d5a746f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.270056:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8200/0xda5c730d5a746f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789185932.270103:0:18686:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789185932.270122:0:18686:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8200/0xda5c730d5a746f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.270149:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf9800/0xda5c730d5a746ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5236c expref: 46 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.270169:0:18686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8200/0xda5c730d5a746f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5236c expref: 45 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.270197:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185932.270200:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789185932.270204:0:18686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8200, rc 0) 00000100:00100000:1.0:1789185932.270272:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+45:15691:x1876096879569792:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 405us (3570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.270279:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 66 00000100:00100000:3.0:1789185932.281320:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.282815:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879569920 00000100:00100000:1.0:1789185932.282830:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879569920 00000100:00100000:1.0:1789185932.283047:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:1.0:1789185932.283060:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c19b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+6:2391:x1876096879569920:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185932.283080:0:18664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185932.283102:0:18664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52373 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185932.283132:0:18664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4cf8c, blocks: 0x0 00010000:00010000:1.0:1789185932.283153:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1789185932.283157:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185932.283166:0:18664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52373 expref: 7 pid: 18664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.283185:0:18664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52373 expref: 7 pid: 18664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.283198:0:18664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf9800, rc 0) 00000100:00100000:1.0:1789185932.283284:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c19b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:2391:x1876096879569920:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 226us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.283292:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 24 00000100:00100000:2.0:1789185932.290011:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.290158:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879570176 00000100:00100000:0.0:1789185932.290170:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879570176 00000100:00100000:0.0:1789185932.290236:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:0.0:1789185932.290249:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+45:15691:x1876096879570176:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789185932.290379:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+45:15691:x1876096879570176:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185932.290387:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 67 00000100:00100000:0.0:1789185932.294872:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.295318:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879570304 00000100:00100000:1.0:1789185932.295331:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879570304 00000100:00100000:1.0:1789185932.295414:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00100000:1.0:1789185932.295425:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+45:15691:x1876096879570304:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789185932.300073:0:17135:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1789185932.300097:0:17135:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789185932.300293:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300322:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300331:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300338:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.300344:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300355:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300387:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f2f28eee00) 00010000:00010000:3.0:1789185932.300391:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185932.300398:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300405:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da000/0xda5c730d5a744bc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300430:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300437:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300444:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300448:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30da800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.300459:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300466:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300476:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:3.0:1789185932.300479:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185932.300482:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300488:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30da800/0xda5c730d5a744c3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300504:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300511:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300517:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300522:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddea00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.300535:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300543:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300551:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f1c33d9b00) 00010000:00010000:3.0:1789185932.300554:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185932.300563:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300569:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddea00/0xda5c730d5a7456b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300586:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300592:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300597:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300602:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf800 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.300606:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300611:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300619:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185932.300621:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185932.300624:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300630:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddf800/0xda5c730d5a745f0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300640:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300646:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300658:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300664:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30db000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.300667:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300675:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300683:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185932.300685:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185932.300688:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300705:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30db000/0xda5c730d5a74613 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300717:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300723:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300729:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300734:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c30dae00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.300736:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300751:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300758:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185932.300760:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185932.300763:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300769:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c30dae00/0xda5c730d5a74659 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300779:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300784:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300790:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300795:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.300797:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300802:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300810:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:3.0:1789185932.300812:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789185932.300815:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.300832:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031000/0xda5c730d5a746de lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789185932.301904:0:17135:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789185932.302205:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+14:15691:x1876096879570304:12345-192.168.204.48@tcp:44:lhsmtool_posix.0 Request processed in 6772us (7334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185932.302219:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 68 00000100:00100000:2.0:1789185932.303402:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898527360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789185932.303486:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789185932.303683:0:19112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898527360 00000100:00100000:1.0:1789185932.303695:0:19112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898527360 00000100:00100000:1.0:1789185932.303757:0:19112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789185932.303769:0:19112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898527360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789185932.303971:0:19112:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789185932.303975:0:19112:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789185932.303977:0:19112:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789185932.303979:0:19112:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789185932 -> 1789185932 00002000:00010000:1.0:1789185932.303982:0:19112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1789185932.304309:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.304322:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.304331:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.304338:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300dde000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.304343:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.304352:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185932.304435:0:19112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1876096898527360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 667us (948us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789185932.304444:0:19112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:1.0:1789185932.304510:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f1c411ea00/2, rc 0, transno 8589934596 00000100:00100000:1.0:1789185932.304518:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898527360:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789185932.304585:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:3.0:1789185932.304589:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789185932.304596:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.304605:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde000/0xda5c730d5a74510 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185932.313683:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185932.313784:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879570432 00000100:00100000:2.0:1789185932.313799:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879570432 00000100:00100000:2.0:1789185932.313872:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:2.0:1789185932.313886:0:18662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d8724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:2391:x1876096879570432:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789185932.317575:0:18662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d8724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:2391:x1876096879570432:12345-192.168.204.48@tcp:16:lhsmtool_posix.0 Request processed in 3671us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185932.317598:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:0.0:1789185932.331622:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185932.331765:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879570688 00000100:00100000:2.0:1789185932.331778:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879570688 00000100:00100000:2.0:1789185932.331853:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:2.0:1789185932.331865:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+14:15691:x1876096879570688:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789185932.331977:0:17155:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789185932.332015:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8200/0xda5c730d5a746f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5236c expref: 14 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.332056:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185932.332063:0:17155:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789185932.332106:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a74701 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.332238:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a74701 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.332253:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a74701 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789185932.332449:0:17155:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000885e0106 reply state 00000000f9559981 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a74701 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.332491:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde600/0xda5c730d5a74701 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.332498:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:2.0:1789185932.332501:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789185932.332504:0:17155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789185932.332862:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+15:15691:x1876096879570688:12345-192.168.204.48@tcp:36:lhsmtool_posix.0 Request processed in 997us (1254us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789185932.332872:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:0.0:1789185932.337661:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.338538:0:19112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879570816 00000100:00100000:1.0:1789185932.338556:0:19112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879570816 00000100:00100000:1.0:1789185932.338648:0:19112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:1.0:1789185932.338662:0:19112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:15691:x1876096879570816:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789185932.338686:0:19112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185932.338730:0:19112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5237a expref: -99 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.338772:0:19112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52373 expref: 8 pid: 18664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.338782:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185932.338786:0:19112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185932.338792:0:19112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 8 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.338834:0:19112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52373 expref: 8 pid: 18664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.338850:0:19112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52373 expref: 8 pid: 18664 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185932.338867:0:19112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19112:1876096898527488:192.168.204.48@tcp:104: 00000100:00100000:1.0:1789185932.340527:0:19112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2e79a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789185932.353286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.353687:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879570944 00000100:00100000:0.0:1789185932.353700:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879570944 00010000:00010000:0.0:1789185932.353758:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52373 expref: 9 pid: 18664 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185932.353819:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:0.0:1789185932.353849:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d8726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:2391:x1876096879570944:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789185932.353871:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789185932.353902:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52373 expref: 9 pid: 18664 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.353960:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52373 expref: 9 pid: 18664 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.353992:0:17140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185932.353997:0:17140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789185932.354006:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 9 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.354030:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 9 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.354080:0:17140:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 9 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185932.354097:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d870f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17140:1876096898527616:192.168.204.48@tcp:105: 00000100:00100000:0.0:1789185932.354310:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789185932.356271:0:19112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e209a93/0xda5c730d5a746fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52373 expref: 9 pid: 18664 timeout: 671 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185932.356306:0:19112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c411ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19112:1876096898527488:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185932.356352:0:19112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 8 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.356419:0:19112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8c00, rc 0) 00000100:00100000:1.0:1789185932.356514:0:19112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+8:15691:x1876096879570816:12345-192.168.204.48@tcp:101:lhsmtool_posix.0 Request processed in 17853us (18868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.356783:0:19112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:2.0:1789185932.357971:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d870f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17140:1876096898527616:192.168.204.48@tcp:105: 00010000:00010000:2.0:1789185932.357997:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789185932.358069:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d8726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:2391:x1876096879570944:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 4222us (4799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185932.358082:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 20 00000100:00100000:0.0:1789185932.364079:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.364347:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879571072 00000100:00100000:1.0:1789185932.364372:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879571072 00000100:00100000:1.0:1789185932.364438:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:1.0:1789185932.364450:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:2392:x1876096879571072:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789185932.364652:0:18664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789185932.364656:0:18664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789185931 00002000:00010000:1.0:1789185932.364658:0:18664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789185929 00002000:00010000:1.0:1789185932.364660:0:18664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789185932 -> 1789185931 00002000:00010000:1.0:1789185932.364663:0:18664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789185932.364747:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+8:2392:x1876096879571072:12345-192.168.204.48@tcp:2:lhsmtool_posix.0 Request processed in 299us (683us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789185932.364756:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 28 00000100:00100000:0.0:1789185932.378067:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185932.378220:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879571200 00000100:00100000:2.0:1789185932.378234:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879571200 00000100:00100000:2.0:1789185932.378296:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00100000:2.0:1789185932.378308:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+8:2389:x1876096879571200:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789185932.378380:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.378405:0:18663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 8 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.378415:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789185932.378420:0:18663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789185932.378443:0:18663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.378489:0:18663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 8 pid: 19112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.378622:0:18663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 8 pid: 19112 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185932.378642:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c4152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18663:1876096898527744:192.168.204.48@tcp:104: 00000100:00100000:2.0:1789185932.378751:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2c1665c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789185932.383757:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c4152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18663:1876096898527744:192.168.204.48@tcp:104: 00010000:00010000:2.0:1789185932.383808:0:18663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185932.386794:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185932.387042:0:20295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879571328 00000100:00100000:3.0:1789185932.387057:0:20295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879571328 00010000:00010000:3.0:1789185932.387143:0:20295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 9 pid: 19112 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185932.387197:0:20295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 21 00000100:00100000:3.0:1789185932.387211:0:20295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+9:2392:x1876096879571328:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789185932.387233:0:20295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789185932.387264:0:20295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 9 pid: 19112 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.387282:0:20295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 9 pid: 19112 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.387312:0:20295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff74e322/0xda5c730d5a74708 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5237a expref: 9 pid: 19112 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.387335:0:20295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185932.387340:0:20295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789185932.387346:0:20295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.387357:0:20295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.387408:0:20295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789185932.387493:0:20295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+8:2392:x1876096879571328:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 285us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185932.387510:0:20295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 21 00010000:00010000:2.0:1789185932.388143:0:18663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.388157:0:18663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.388185:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.388194:0:18663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.388218:0:18663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.388226:0:18663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddf000 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:2.0:1789185932.388231:0:18663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.388242:0:18663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.388257:0:18663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.388265:0:18663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037971372/0xda5c730d5a7470f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789185932.388343:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:2389:x1876096879571200:12345-192.168.204.48@tcp:1:lhsmtool_posix.0 Request processed in 10035us (10289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185932.388352:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 29 00000100:00100000:0.0:1789185932.402856:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185932.406759:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879571584 00000100:00100000:3.0:1789185932.406781:0:18686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879571584 00000100:00100000:3.0:1789185932.407214:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 70 00000100:00100000:3.0:1789185932.407229:0:18686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+15:15691:x1876096879571584:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789185932.407348:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.407381:0:18686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52318 expref: 15 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.407393:0:18686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.407441:0:18686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52318 expref: 15 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.407458:0:18686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52318 expref: 15 pid: 17157 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185932.407475:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d8726d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18686:1876096898527872:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185932.407597:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1fa000 going to sleep for 11 seconds 00000100:00100000:3.0:1789185932.413985:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d8726d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18686:1876096898527872:192.168.204.48@tcp:104: 00010000:00010000:3.0:1789185932.414042:0:18686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185932.415406:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.415746:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879571712 00000100:00100000:1.0:1789185932.415760:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879571712 00010000:00010000:1.0:1789185932.415814:0:17142:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52318 expref: 16 pid: 17157 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185932.415864:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 22 00000100:00100000:1.0:1789185932.415876:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d8726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+16:2392:x1876096879571712:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185932.415895:0:17142:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185932.415944:0:17142:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52318 expref: 16 pid: 17157 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.415960:0:17142:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52318 expref: 16 pid: 17157 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.415987:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300dde800/0xda5c730d5a745e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52318 expref: 16 pid: 17157 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.416008:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:1.0:1789185932.416015:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7467c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52349 expref: 15 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.416037:0:17142:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.416047:0:17142:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.416056:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.416082:0:17142:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185932.416150:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d8726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+15:2392:x1876096879571712:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 277us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.416157:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 22 00010000:00010000:3.0:1789185932.417082:0:18686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.417098:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.417380:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.417397:0:18686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52365 expref: 15 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.417407:0:18686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.417449:0:18686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52365 expref: 15 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.417466:0:18686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52365 expref: 15 pid: 18686 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185932.417482:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d8727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18686:1876096898528000:192.168.204.48@tcp:104: 00000100:00100000:3.0:1789185932.417597:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185932.422085:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.422232:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d8727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18686:1876096898528000:192.168.204.48@tcp:104: 00010000:00010000:1.0:1789185932.422268:0:18686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185932.422736:0:20295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879571840 00000100:00100000:0.0:1789185932.422748:0:20295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879571840 00010000:00010000:1.0:1789185932.422881:0:20295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52365 expref: 16 pid: 18686 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789185932.423100:0:20295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 23 00000100:00100000:1.0:1789185932.423113:0:20295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c37cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+16:2391:x1876096879571840:12345-192.168.204.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789185932.423133:0:20295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789185932.423142:0:20295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52365 expref: 16 pid: 18686 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.423157:0:20295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52365 expref: 16 pid: 18686 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.423183:0:20295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f1c1bf8400/0xda5c730d5a746e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52365 expref: 16 pid: 18686 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.423203:0:20295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185932.423209:0:20295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.423220:0:20295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.423229:0:20295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.423834:0:20295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789185932.423946:0:20295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c37cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+15:2391:x1876096879571840:12345-192.168.204.48@tcp:103:ldlm_bl.0 Request processed in 830us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.423971:0:20295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 23 00010000:00010000:3.0:1789185932.426294:0:18686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.426318:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789185932.426636:0:18686:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1789185932.426813:0:18686:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789185932.426860:0:18686:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1789185932.426996:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d8725180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18686:1876096898528128:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789185932.427228:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185932.427314:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f2ce1fa780 going to sleep for 11 seconds 00000100:00100000:1.0:1789185932.427433:0:17896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898528128 00000100:00100000:1.0:1789185932.427445:0:17896:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898528128 00000100:00100000:1.0:1789185932.427604:0:17896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789185932.427616:0:17896:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d8726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18686:x1876096898528128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789185932.427751:0:17896:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d8726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18686:x1876096898528128:12345-0@lo:1000:mdt00_003.0 Request processed in 137us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.427760:0:17896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789185932.427859:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d8725180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18686:1876096898528128:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789185932.428094:0:18686:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1789185932.428156:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d870d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18686:1876096898528256:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789185932.428194:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185932.428672:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789185932.428746:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898528256 00000100:00100000:3.0:1789185932.428753:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898528256 00000100:00100000:3.0:1789185932.428794:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789185932.428803:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18686:x1876096898528256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789185932.428998:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18686:x1876096898528256:12345-0@lo:1000:mdt00_003.0 Request processed in 196us (803us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789185932.429005:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789185932.429156:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d870d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18686:1876096898528256:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789185932.429205:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429217:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429227:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429234:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0200 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185932.429239:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429248:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429266:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:0.0:1789185932.429269:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185932.429275:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429282:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0200/0xda5c730d5a7471d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429337:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429343:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429348:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429353:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddfa00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185932.429370:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429376:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429384:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:0.0:1789185932.429386:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789185932.429394:0:18686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7467c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52349 expref: 18 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429406:0:18686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7467c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52349 expref: 18 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429415:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7467c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52349 expref: 18 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.429474:0:18686:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0e00/0xda5c730d5a7467c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52349 expref: 18 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185932.429503:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d870df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18686:1876096898528384:192.168.204.48@tcp:105: 00000100:00100000:0.0:1789185932.429587:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff98f1c2c4bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789185932.436805:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185932.436853:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879571968 00000100:00100000:3.0:1789185932.436865:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879571968 00000100:00100000:3.0:1789185932.436965:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:3.0:1789185932.436977:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d8725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+19:15689:x1876096879571968:12345-192.168.204.48@tcp:49:bash.0 00000100:00100000:3.0:1789185932.437153:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d8725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+19:15689:x1876096879571968:12345-192.168.204.48@tcp:49:bash.0 Request processed in 177us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185932.437162:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 12 00000100:00100000:0.0:1789185932.437778:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d870df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18686:1876096898528384:192.168.204.48@tcp:105: 00010000:00010000:0.0:1789185932.437814:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437827:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddfa00/0xda5c730d5a74675 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437871:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437888:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437902:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437928:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437934:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437941:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437947:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c0031a00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185932.437951:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437977:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.437991:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:0.0:1789185932.437995:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789185932.438000:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.438005:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74724 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.438016:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.438037:0:18686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.438045:0:18686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.438050:0:18686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2ff9c0000 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:0.0:1789185932.438053:0:18686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.438058:0:18686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.438067:0:18686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:0.0:1789185932.438069:0:18686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789185932.438073:0:18686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.438091:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2ff9c0000/0xda5c730d5a74716 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18686 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789185932.438276:0:18686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+18:15691:x1876096879571584:12345-192.168.204.48@tcp:57:lhsmtool_posix.0 Request processed in 31050us (35435us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1789185932.438285:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 70 00000020:00080000:0.0:1789185932.438291:0:18686:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789185932.439740:0:17191:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789185932.439750:0:17191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789185932.439800:0:17191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789185932.439809:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789185932.444839:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185932.445788:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879572224 00000100:00100000:2.0:1789185932.445803:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879572224 00000100:00100000:2.0:1789185932.445986:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 13 00000100:00100000:2.0:1789185932.446001:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d8725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+18:15691:x1876096879572224:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789185932.449830:0:17159:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789185932.449932:0:17159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1789185932.450018:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.450040:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.450055:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.450065:0:17159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.450072:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.450078:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789185932.450102:0:17159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789185932.450243:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d8725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+20:15691:x1876096879572224:12345-192.168.204.48@tcp:35:lhsmtool_posix.0 Request processed in 4239us (7221us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1789185932.450254:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 13 00000020:00080000:2.0:1789185932.450261:0:17159:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789185932.450665:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.450705:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879572352 00000100:00100000:1.0:1789185932.450715:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879572352 00000100:00100000:1.0:1789185932.450770:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 30 00000100:00100000:1.0:1789185932.450782:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+7:15689:x1876096879572352:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:1.0:1789185932.450803:0:18664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789185932.450825:0:18664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000430a92cd/0xda5c730d5a74732 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52381 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789185932.450854:0:18664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa4cf8b, atime: 0x6aa4cf89, ctime: 0x6aa4cf8b, blocks: 0x0 00010000:00010000:1.0:1789185932.450880:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1789185932.450885:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789185932.450895:0:18664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000430a92cd/0xda5c730d5a74732 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52381 expref: 8 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.450960:0:18664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000430a92cd/0xda5c730d5a74732 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52381 expref: 8 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.450974:0:18664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f1c1bf8400, rc 0) 00000100:00100000:1.0:1789185932.451006:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+8:15689:x1876096879572352:12345-192.168.204.48@tcp:101:bash.0 Request processed in 227us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.451453:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 30 00010000:00010000:1.0:1789185932.451681:0:17144:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789185932.451690:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.451699:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f300ddee00 already unused, calling callback (ffffffffc0d1a8b0) 00010000:00010000:1.0:1789185932.451705:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.451716:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.451732:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f300ff3a00) 00010000:00010000:1.0:1789185932.451735:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789185932.451740:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.451746:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f300ddee00/0xda5c730d5a7472b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789185932.451763:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185932.451765:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185932.451777:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185932.455943:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.456020:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879572480 00000100:00100000:0.0:1789185932.456044:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879572480 00000100:00100000:0.0:1789185932.456121:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 71 00000100:00100000:0.0:1789185932.456134:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+20:15689:x1876096879572480:12345-192.168.204.48@tcp:101:bash.0 00010000:00010000:0.0:1789185932.456162:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185932.456188:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74739 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee52388 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.456236:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031800/0xda5c730d5a74740 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.456254:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031800/0xda5c730d5a74740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.456269:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031800/0xda5c730d5a74740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.456650:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74739 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52388 expref: 22 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.456673:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031800/0xda5c730d5a74740 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee52388 expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.456691:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:0.0:1789185932.456694:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789185932.456699:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031800, rc 0) 00000100:00100000:0.0:1789185932.456888:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+21:15689:x1876096879572480:12345-192.168.204.48@tcp:101:bash.0 Request processed in 756us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185932.456896:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 71 00000100:00100000:1.0:1789185932.463194:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185932.463311:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879572736 00000100:00100000:3.0:1789185932.463325:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879572736 00000100:00100000:3.0:1789185932.463525:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 14 00000100:00100000:3.0:1789185932.463539:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+21:15689:x1876096879572736:12345-192.168.204.48@tcp:35:bash.0 00000001:00080000:3.0:1789185932.463831:0:17158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1789185932.463995:0:17158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1789185932.464144:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+24:15689:x1876096879572736:12345-192.168.204.48@tcp:35:bash.0 Request processed in 608us (963us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1789185932.464153:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 14 00000020:00080000:3.0:1789185932.464160:0:17158:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789185932.580990:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.581132:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879572992 00000100:00100000:0.0:1789185932.581146:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879572992 00000100:00100000:0.0:1789185932.581236:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 72 00000100:00100000:0.0:1789185932.581249:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c4152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+24:15701:x1876096879572992:12345-192.168.204.48@tcp:101:lfs.0 00010000:00010000:0.0:1789185932.581282:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789185932.581310:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae2b9231ee5238f expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789185932.581463:0:17157:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789185932.581597:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74747 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5238f expref: 26 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.581615:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f1c33d9f00) 00010000:00010000:0.0:1789185932.581619:0:17157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789185932.581626:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c0031a00/0xda5c730d5a74747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.48@tcp remote: 0xae2b9231ee5238f expref: 26 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789185932.581656:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f2c0031a00, rc 0) 00000100:00100000:0.0:1789185932.581741:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c4152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+25:15701:x1876096879572992:12345-192.168.204.48@tcp:101:lfs.0 Request processed in 492us (764us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1789185932.581773:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 72 00000100:00100000:0.0:1789185932.588423:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:3.0:1789185932.589066:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879573120 00000100:00100000:3.0:1789185932.589083:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879573120 00000100:00100000:3.0:1789185932.589172:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 73 00000100:00100000:3.0:1789185932.589185:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d870df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+25:15701:x1876096879573120:12345-192.168.204.48@tcp:34:lfs.0 00010000:00010000:3.0:1789185932.589289:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589312:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589327:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589345:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589352:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589371:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589473:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589483:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589513:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789185932.589581:0:17156:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589599:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589606:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589614:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589621:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a2400 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.589626:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589880:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589895:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f2f28ee700) 00010000:00010000:3.0:1789185932.589898:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185932.589904:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589955:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a2400/0xda5c730d5a74755 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.589987:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590004:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590011:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590016:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3c00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.590019:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590026:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590034:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f2f28eee00) 00010000:00010000:3.0:1789185932.590037:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185932.590040:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590046:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3c00/0xda5c730d5a7475c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590064:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590070:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590076:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590081:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f2c13a3e00 already unused, calling callback (ffffffffc192c4f0) 00010000:00010000:3.0:1789185932.590090:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590096:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590103:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f1c33d9600) 00010000:00010000:3.0:1789185932.590106:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789185932.590109:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789185932.590115:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f2c13a3e00/0xda5c730d5a74763 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789185932.590231:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d870df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+25:15701:x1876096879573120:12345-192.168.204.48@tcp:34:lfs.0 Request processed in 1046us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185932.590240:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 73 00000100:00100000:3.0:1789185932.594097:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185932.594267:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879573376 00000100:00100000:2.0:1789185932.594281:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879573376 00000100:00100000:2.0:1789185932.594349:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:2.0:1789185932.594371:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d8727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+25:15701:x1876096879573376:12345-192.168.204.48@tcp:35:lfs.0 00000100:00100000:2.0:1789185932.594695:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d8727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+26:15701:x1876096879573376:12345-192.168.204.48@tcp:35:lfs.0 Request processed in 327us (614us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1789185932.594725:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 15 00000100:00100000:1.0:1789185932.652633:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.652694:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.652813:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.652847:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:0.0:1789185932.652904:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879574016 00000100:00100000:0.0:1789185932.652941:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879574016 00000100:00100000:0.0:1789185932.653039:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:0.0:1789185932.653053:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879574016:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185932.653169:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879574016:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 119us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185932.653177:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 69 00000100:00100000:3.0:1789185932.653507:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879573504 00000100:00100000:3.0:1789185932.653513:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879573504 00000100:00100000:3.0:1789185932.653565:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 170 00000100:00100000:3.0:1789185932.653574:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+13:2390:x1876096879573504:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:3.0:1789185932.653605:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c2333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aef2505e-7927-4768-ad72-37facf71ba21+13:2390:x1876096879573504:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 33us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185932.653612:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 170 00000100:00080000:3.0:1789185932.653804:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789185932.654849:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.654883:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.654927:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879573632 00000100:00100000:1.0:1789185932.654934:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879573632 00000100:00100000:1.0:1789185932.654991:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879573888 00000100:00100000:1.0:1789185932.654995:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879573888 00000100:00100000:1.0:1789185932.655021:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 70 00000100:00100000:1.0:1789185932.655031:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879573632:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185932.655168:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 71 00000100:00100000:0.0:1789185932.655177:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2390:x1876096879573888:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:0.0:1789185932.655241:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1735a8d-9a99-4c85-bc30-d3542203dc16+6:2390:x1876096879573888:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 65us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185932.655248:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 71 00000100:00100000:0.0:1789185932.655369:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185932.655403:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879573632:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 373us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185932.655410:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 70 00000100:00080000:1.0:1789185932.656164:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789185932.656171:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789185932.656775:0:19112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879573760 00000100:00100000:2.0:1789185932.656792:0:19112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879573760 00000100:00100000:2.0:1789185932.656872:0:19112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879574272 00000100:00100000:2.0:1789185932.656877:0:19112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879574272 00000100:00100000:2.0:1789185932.656917:0:19112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:2.0:1789185932.656928:0:19112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879573760:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185932.657019:0:19112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e5c6ede-0048-44ff-85dd-b5867120aa40+5:2390:x1876096879573760:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 91us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185932.657028:0:19112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 25 00000100:00100000:2.0:1789185932.657052:0:19112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00100000:2.0:1789185932.657059:0:19112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c411d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879574272:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185932.657098:0:19112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c411d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879574272:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 39us (4250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185932.657104:0:19112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 26 00000100:00080000:1.0:1789185932.657829:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789185932.658201:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879574144 00000100:00100000:3.0:1789185932.658211:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879574144 00000100:00080000:1.0:1789185932.658286:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789185932.658481:0:19112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 27 00000100:00100000:2.0:1789185932.658494:0:19112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d872dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879574144:12345-192.168.204.48@tcp:400:kworker.0 00000100:00100000:2.0:1789185932.658619:0:19112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d872dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1735a8d-9a99-4c85-bc30-d3542203dc16+5:2390:x1876096879574144:12345-192.168.204.48@tcp:400:kworker.0 Request processed in 128us (3261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185932.658627:0:19112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 27 00010000:00010000:3.0:1789185932.710146:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789185933.734576:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789185933.736297:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898528512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789185933.736895:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789185933.737142:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898528512 00000100:00100000:0.0:1789185933.737158:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898528512 00000100:00100000:0.0:1789185933.737310:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789185933.737324:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876096898528512:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789185933.737434:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789185933.738052:0:18665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789185933.738136:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876096898528512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 814us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789185933.738145:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789185933.738619:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876096898528512:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789185934.439564:0:20333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1789185934.760228:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789185934.760412:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f2d8727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898528640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185934.760465:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898528768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789185934.771308:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185934.779773:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898528640 00000100:00100000:2.0:1789185934.779798:0:18666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898528640 00000100:00100000:2.0:1789185934.779925:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789185934.779940:0:18666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f2d8724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898528640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789185934.780000:0:18666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789185934.780128:0:18666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f2d8724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876096898528640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 193us (8830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185934.780136:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789185934.780200:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185934.783667:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f2d8727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876096898528640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789185934.784169:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789185934.784571:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898528768 00000100:00100000:3.0:1789185934.784583:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898528768 00000100:00100000:3.0:1789185934.784653:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789185934.784665:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898528768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789185934.784716:0:17160:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789185934.784812:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876096898528768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789185934.784820:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789185934.784936:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876096898528768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789185935.270710:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898528896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789185935.270816:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789185935.271048:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096898528896 00000100:00100000:2.0:1789185935.271059:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096898528896 00000100:00100000:2.0:1789185935.271121:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789185935.271131:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898528896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789185935.271176:0:17161:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789185935.271244:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c33fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876096898528896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789185935.271252:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789185935.271456:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98f1c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876096898528896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789185935.719018:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:2.0:1789185935.719078:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.48@tcp (source: 12345-192.168.204.48@tcp) 00000100:00100000:1.0:1789185935.719211:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879574528 00000100:00100000:1.0:1789185935.719224:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879574528 00000100:00100000:1.0:1789185935.719324:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00100000:1.0:1789185935.719345:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+8:2390:x1876096879574528:12345-192.168.204.48@tcp:16:kworker.0 00000100:00100000:1.0:1789185935.719512:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e5c6ede-0048-44ff-85dd-b5867120aa40+8:2390:x1876096879574528:12345-192.168.204.48@tcp:16:kworker.0 Request processed in 177us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789185935.719520:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 31 00000100:00080000:2.0:1789185935.719727:0:17151:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789185935.723920:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876096879574400 00000100:00100000:3.0:1789185935.723940:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876096879574400 00002000:00100000:3.0:1789185935.724002:0:18667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff98f1c3487480 x1876096879574400/t0(0) o4->8e5c6ede-0048-44ff-85dd-b5867120aa40@192.168.204.48@tcp:536/0 lens 504/0 e 0 to 0 dl 1789185946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789185935.724256:0:18667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c3487480 with x1876096879574400 ext(0->8) 00002000:00010000:3.0:1789185935.724264:0:18667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c3487480 00000100:00100000:3.0:1789185935.724957:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.48@tcp, seq: 0 00000100:00100000:3.0:1789185935.724975:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+8:2390:x1876096879574400:12345-192.168.204.48@tcp:4:bash.0 00000100:00100000:3.0:1789185935.726854:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff98f1c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8e5c6ede-0048-44ff-85dd-b5867120aa40+10:2390:x1876096879574400:12345-192.168.204.48@tcp:4:bash.0 Request processed in 1872us (7761us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789185935.726871:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.48@tcp, seq: 0 00002000:00100000:3.0:1789185935.726901:0:18667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff98f1c3487480 x1876096879574400/t8589934599(0) o4->8e5c6ede-0048-44ff-85dd-b5867120aa40@192.168.204.48@tcp:536/0 lens 504/448 e 0 to 0 dl 1789185946 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789185935.726940:0:18667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98f1c3487480 with x1876096879574400 ext(0->8) 00002000:00010000:3.0:1789185935.726960:0:18667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f1c3487480 00010000:00010000:1.0:1789185935.782690:0:17144:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789185935.974577:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 Debug log: 43913 lines, 43913 kept, 0 dropped, 0 bad.